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ABSTRACT 

This study identified features of innovations which 
help decision-makers compare and select appropriate innovations for 
adoption, resulting in the development of guidelines for evaluating 
innovation characteristics. Following a comprehensive search of the 
literature for taxonomic dimensions of innovations, interviews were 
held with school superintendents and others in Ohio. In order to 
assess the characteristics gleaned from the literature search in the 
context of administrative needs. The Evaluation Guide was both pilot 
tested and field tested. Results of the study indicated the following 
items as most essential to administrators in evaluating innovations; 
(1) quantity of staff, (2) costs, (3) availability of dollars, (4) 
space (housing), (5) lead time, (6) source of dollars, (7) hardware, 
and (8) complexity of innovation. Items rated at least essential to 
teachers and administrators were; (1) rate of learning, (2) entry and 
advancement in an occupation, (3) new relationships among groups, (4) 
cyclical considerations, (5) economic and social efficiencies, (6) 
reliability, and (7) divisibility. Also, a taxonomy of innovations 
was not feasible at the present time, and innovations were difficult 
to define with few unique characteristics for vocational and 
technical education. (JS) 
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MISSION OF THE CENTER 



The Center for Vocational and Technical Education, an 
independent unit on The Ohio State University campus, operates 
under a grant from the National Center for Educational Research 
and Development, U.S. Office, of Education. It serves a catalytic 
role in establishing consortia to focus on relevant problems in 
vocational and technical education. The Center is comprehensive 
in its commitment and responsibility, multidisciplinary in its 
approach and inter institutional in its program. 

The Center's mission is to strengthen the capacity of state 
educational systems to provide effective occupational education 
programs consistent with individual needs and manpower require- 
ments by: 

• Conducting research and development to fill voids in 
existing knowledge and to develop methods for applying 
knowledge. 

• Programmatic focus on state leadership development, voca- 
tional teacher education, curriculum, vocational choice 
and adjustment. 

• Stimulating and strengthening the capacity of other agen- 
cies and institutions to create durable solutions to 
significant problems. 

• Providing a national information storage, retrieval and 
dissemination system for vocational and technical educa- 
tion through the affiliated ERIC Clearinghouse. 
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PREFACE 



Exemplary innovations should be described in a manner which 
facilitates their evaluation by potential consumers. By focusing 
adopters' attention on benefits and costs of installing an inno- 
vation, a more realistic estimate of adoption desirability can be 
obtained. This report specifies some of the important conditions 
which should be considered when adopting an innovation. 

We acknowledge the assistance of Richard 0. Carlson at the 
University of Oregon, and Herbert Steffens, Coordinator of the 
Western States Small Schools Project, Carson City, Nevada who con- 
sulted with the researchers in the initial and formative stages 
of the study. The cooperation of Dr. Sidney High and the four 
local exemplary program directors is appreciated. t 
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Randall L. Wells, research associate, who conducted the study, we 
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Russell, research associate; Ralph J. Kester , project associate; 
and Lois Harrington, technical assistant. 

For reviews of this publication, we are indebted to Dr. James 
W. Hensel, Chairman of the Department of Vocational, Technical and 
Adult Education at the University of Florida; Dr. John D. Jenkins, 
College of Applied Arts and Technology at Eastern Kentucky Univer- 
sity; Dr. Calvin J. Cotrell, Research and Development Specialist 
at The Center; and Dr. Wayne E. Schroeder, Dissemination Special- 
ist at The Center. 
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SUMMARY 



PROBLEM 

This study identified features of innovations which help 
decision-makers compare and select appropriate innovations for 
adoption,, thus resulting in the development of guidelines for 
evaluating innovation characteristics. 



PROCEDURES 

Following a comprehensive search of the literature for tax- 
onomic dimensions which describe innovations, interviews were held 
with school superintendents and others in Ohio . The interviews 
provided an opportunity to assess the characteristics gleaned from 
the literature search in the context of administrative needs. A 
prototype of the Innovations Evaluation Guide was pilot tested in 
a junior high school and revised before the field test. Staff 
members of vocational education exemplary programs in four local 
sites in Georgia, Mississippi, Kentucky, and Tennessee evaluated 
the importance of the Guide items. In addition, state supervisors 
and local project directors of exemplary programs evaluated the 
Guide items. The 38 items in the Guide were revised based on the 
field test data. 



RESULTS 

Results of the study indicated the following items were per- 
ceived as most "essential" for evaluating innovations : 

1) Quantity of staff, 

2) Costs, 

3) Availability of dollars, 

4) Space (Housing), 

5) Lead time, 

6) Source of dollars, 

7) Hardware, 

8) Complexity of the innovation. 

Many of these items were considered essential for the administrator 
only . 
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The items rated as least "essential": 

1) Rate of learning, 

2) Entry and advancement in an occupation, 

3) New relationships among groups, 

4) Cyclical considerations, 

5) Economic and social efficiencies, 

6) Reliability, 

7) Divisibility. 

These items were perceived most frequently to be decisions made by 
both teachers and administrators. No items were identified as 
"essential" for the decisions of the teacher only. 

A taxonomy of innovations was deemed not possible with the 
present level of knowledge and technology,. Innovations were dif- 
ficult to define. When identified, they exhibited few unique 
characteristics for vocational and technical education. 

State supervisors, local administrators, local project direc- 
tors, and local teachers held similar perceptions of the importance 
of the Guide items. The involvement of local administrators and 
local teachers in school -related tasks had no effect on the per- 
ceived importance of Guide items. 

The reader might find it helpful to scan the Innovations 
Evaluation Guide in Appendix B before reading the report. This 
will familiarize the reader with the terminology used in reporting 
the development of the Guide. 
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CHAPTER I 



BACKGROUND OF THE STUDY 



INTRODUCTION 

The need for renewal has long been recognized by taxpayers 
and school officials alike as a high priority in public education. 
Movements for change and redirection are confronted by the forces 
of tradition and stability; this confrontation has transformed the 
orderly search for knowledge and excellence into chaos and con- 
fusion for some- school districts. 

An alternative to change by revolution in public school sys- 
tems is change through the evolution of tested new ideas for im - 
proving the education of the child. This education should be 
deliberate and programmatic for not all change is improvement; 
shortcutting the time required to evaluate prospective innovations 
risks mediocrity of new products in education. The federal gov- 
ernment's move to create a network of research and development 
centers and regional laboratories facilitates the process of 
planned change in education. Products developed in the centers 
and engineered for school systems in the laboratories are designed 
to improve educational systems. Many millions of dollars are 
being invested in the education product development system. Since 
1963, $81 million have been invested by the federal government in 
research and development for vocational education alone. 

These dollars are in response to a need for innovation in 
vocational and technical education. A cursory review of the U.S. 
Office of Education annual report of State Research Coordinating 
Unit Activities (1971) will reveal a number of innovative ideas 
funded in local education agencies, state divisions of vocational 
and technical education, and teacher education agencies by the Re- 
search Coordinating Units. The extent and diversity of the funded 
ideas indicates a key problem associated with the diffusion of 
sound innovations in vocational and technical education: innova- 

tions are funded and developed on a rather small scale. In some 
cases, little attention is being given to the diffusion of the 
product after the funds have been spent. In other cases, the final 
product is being promulgated without evidence of its validity and/ 
or reliability. 

In an effort to encourage the development and dissemination 
of practical innovations, the Exemplary Programs and Services 
Branch of the Division of Vocational and Technical Education in 
the U.S. Office of Education in conjunction with the states ad- 
ministers funds for exemplary programs in vocational and technical 
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education. These are tested innovations in the process of being 
installed in education agenries. Presumably, these projects will 
result in information about the innovation which would be useful 
to other school district officials who are thinking about trying 
the new idea. 

On a broader scale, the National Center for Educational Com- 
munication in the U.S. Office of Education in cooperation with 
Educational Testing Service (1971) has funded a search for com- 
prehensive information on selected products of research and devel- 
opment for education. Consultants were employed from the Educa- 
tional Products Information Exchange (EPIE) I and criteria were 
formulated for the selection of nine products for focused dissem- 
ination. This activity recognized the need for more adequate 
dissemination of bona fide products to education agencies. 

The innovation classification scheme and evaluation guide 
reported in this publication is a systematic attempt to resolve a 
small part of the problem of knowledge utilization in vocational 
and technical education. Without a classification system and 
evaluative criteria for comparing innovations, potential adopters 
must rely on intuition and spontaneous advice from associates in 
their selection of an innovation for trial and adoption. 

The first step in this study of innovations was the develop- 
ment of a classification scheme with the following characteristics 
(1) mutually exclusive categories; (2) categories exhaustive of 
vocational and technical education innovations; and (3) taxonomic 
dimensions relevant to the adoption or rejection of an exemplary 
innovation . 

Based on the recommendations of the consultants, the inter- 
views with the superintendents, and the review of the literature, 
the scope of the taxonomy changed. Questions were raised about 
the usefulness of a classification scheme for innovations even if 
the taxonomy dimensions were fully developed. It seemed far more 
useful to generate questions which, when answered, could pinpoint 
the benefits of an innovation and its requirements for successful 
installation . 



Dimensions of the Taxonomy 



The task of constructing dimensions 
to be a formidable one. The innovations 



of the taxonomy proved 
identified through the 



* EP I E is a nonprofit 
educational materials and 
makers select appropriate 
EPIE Institute is located 
10016 . 



organization that conducts studies of 
systems in an effort to help decision- 
innovations for school systems. The 
at 386 Park Avenue South, New York City 
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literature search were compared for common characteristics. Mu- 
tually exclusive dimensions sufficiently broad to encompass all 
innovations were difficult to find. The Educational Programs for 
Innovative Curriculum (EPIC)2 evaluation center developed an eval- 
uation scheme for organizational structures affecting programs. 

It included the dimensions of instructional characteristics, be- 
havioral characteristics and institutional characteristics. Each 
of these dimensions contained levels which formed cells for the 
classification of educational programs. Bhola (1965b) suggested 
two dimensions for classifying the context of innovation adoption 
situations, one is "costs" and the other "returns." He discusses 
the effect of visibility of characteristics of innovations on the 
likelihood of acceptance or rejection. A taxonomic classification 
of adult basic education programs (Pattison, 1968) includes the 
following dimensions: program operations, supervisor, coordinator, 

teachers, time schedule, physical facilities, preplanning, and 
teaching goals. 

Most of the planning and development of the taxonomy occurred 
during Change Process Program Area meetings at The Center for Voca- 
tional and Technical Education. 3 The scheme which developed is 
tentative and heuristic. It represents a modest first step in the 
direction of a taxonomic classification. Figure 1 illustrates the 
taxonomy as it could be used to classify innovations appropriate 
for vocational and technical education. It is interesting to note 
that the "Types of Innovation" dimension of the taxonomy, which 
includes the categories of individual -behavioral , organizational- 
legislative and scientif ic-technological , corresponds well with 
the major categories listed under impediments to accountability by 
Hencley (1971): philosophical -ideological , political-legal, and 

technological -economic . 

The taxonomy was reviewed by two consultants early in the 
history of the project. They suggested major revisions in the 
format of the classification scheme. One commented that a tax- 
onomy would be interesting, but not as useful as a means of ap- 
praising characteristics of innovations. Other suggested re- 
visions included the need for statements describing what the in- 
novations can do, the incorporation of scanning devices to allow 
busy administrators to view tables of relationships quickly, an 
emphasis on questions as a guide for prospective adopters, the 



O 

The EPIC Evaluation Center in Tucson, Arizona functions as 
a regional center for the purpose of providing educational agencies 
with the technical assistance and facilities necessary for the 
development and maintenance of sound and continuous programs of 
eva I uat i on . 

•^We wish to acknowledge the suggestions of our colleague, 

Frank Pratzner, who suggested the "Types of Innovation" dimension. 
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Figure 1 

Dimensions of the Taxonomy of Innovations 



addition of a section on attitudes caused by the innovation, and 
the addition of a section on policy changes. 

As a result of these suggestions, the decision was made to 
develop a guide for evaluating innovation which could be used by 
school administrators or other prospective adopters of new educa- 
tional products. 



STATEMENT OF THE PROBLEM 

Any educator faced with the task of appraising the desirabil- 
ity of an innovation before trying it in his school system needs 
a guide to assist him in analyzing essential benefits of the inno- 
vation and its requirements for successful ins tallation . The 
prospective adopter should analyze the innovation into its com- 
ponent parts, understand the nature and extent of resources re- 
quired for complete installation, and estimate the adjustment 
which would be required in the existing education system. The 
alleged benefits of the innovation should be readily apparent and 
documented with evidence from field trials with the product in 
realistic education settings. Once decision-makers have decided 
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to try the innovation, a description of the innovation's charac- 
teristics would be useful in convincing staff affected by the 
change of its desirability. At the present time, very limited 
information is available about most innovations in vocational and 
technical education. ^ Most developers are perfecting the technical 
aspects of their products, but they are not attending to questions 
posed by the installation of the product in an education system. 

A guideline and format are needed which will facilitate communica- 
tion and understanding between the developer of the product and 
its consumer. Such guidelines would be useful to individuals such 
as change agents and potential adopters who are instrumental in 
the adoption of exemplary innovations. 



OBJECTIVES 

This study was designed as the first of a series to develop 
a frame of reference for the diffusion of exemplary innovations 
in vocational and technical education. This study was to classify 
innovations by their characteristics in a manner which would facil- 
itate their evaluation by potential adopters. A second study of 
the adopting units (teacher education departments, state divisions 
of vocational and technical education, and local education agencies 
in vocational and technical education is planned to precede the 
third study, the development of prescriptive diffusion strategies 
for innovations in vocational and technical education. 

The purpose of this study is to identify features of innova- 
tions which will help decision-makers compare and select appro- 
priate innovations as solutions to local problems. No attempt has 
been made to dwell on problem identification or need for the in- 
novation. The objective of this study was to develop a Guide with 
items which would evaluate characteristics of exemplary innovations 
required for successful installation in an adopting unit . 



LIMITATIONS OF THE STUDY 

This study assumed each innovation which would be evaluated 
by the criteria in the Guide will have been field tested for tech- 
nical proficiency. The items in the Guide were written from the 
innovation adopter's perspective; no attention was given to cri- 
teria necessary for maintaining the efficacy of the innovation. 



recent search for tested ideas in education conducted by 
the Far West Laboratory for project ALERT (Alternatives for Learn- 
ing through Educational Research and Technology) d i scover ed' very 
few, if any, innovations in vocational and technical education. 
Documented in a phone conversation with C. L. Hutchins, February 
23 , I 97 I . 
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Except by implication, no criteria in the Guide were designed 
to assess the need for the innovation. Guide items relate to 
characteristics (or attributes) of the innovation only. Conditions 
impinging on the adoption of innovations are so varied and diverse 
that it becomes very difficult to describe situational character- 
istics in common terms. 

The Guide places primary emphasis on judging the desirability 
of an innovation rather than the speed of an innovation's adoption. 



PROCEDURES 

The Search for Innovations . A search of ERIC microfiche and 
related literature was conducted to identify innovations in voca- 
tional and technical education. Of particular interest were pub- 
lications identifying innovations in the service areas such as 
Cochran (1970). Some publications such as Von Haden and King 
(1971) discussed the advantages and disadvantages of particular 
innovations in education. Some of the research studies of per- 
ceived characteristics of innovations were useful in identifying 
questions of concern to potential adopters . 

Interviews with Superintendents . Following the review of 
literature, questions were posed to innovative superintendents in 
Ohio. Professors of Educational Administration at The Ohio State 
University were asked to nominate superintendents whom they per- 
ceived as innovative. Ten names were suggested. Six superinten- 
dents were interviewed by the research team during May, 1971. 

The names of the superintendents are listed in Appendix E. The 
questions asked of each superintendent are listed in Appendix F. 

The interviews usually included members of their staffs and ranged 
from two to four hours . This activity served as a context evalua- 
tion for the Guide questions identified in the review of literature. 

Development of the Instrument . In June of 1971, a supervisor 
of vocational education was employed on the project as a research 
associate. During the summer months, he used the information 
acquired through the literature search and the personal interviews 
to construct the first draft of the Guide. More interviews were 
held with members of the research staff of the Columbus public 
schools. The Guide was reviewed by the program officer' for the 
Institute for the Development of Educational Activities '^IDEA) 5 
at the Dayton office. A consultant was employed to review the 
GiJTHe'^a^nd recommend changes in its design. 



^IDEA is arionprofit corporation engaged in educational im- 
provement. It is an affiliate of the Charles F. Kettering Founda- 
tion. 
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The data collection instrument began to look like a checklist 
of innovation characteristics, rather than a classification scheme. 
The underlying dimensions of the Guide and the scope, magnitude, 
pervasiveness,, etc. of the innovation were implied in the questions 
on the checklist. 

The revised version, now called an Innovations Evaluation 
Guide, was pilot tested in a local junior high school for clarity 
and readability. Each of the research team members reviewed the 
instrument in detail with a teacher or administrator in the school 
system. Through the cooperation of the school personnel, several 
revisions were made in the Guide and its accompanying data col- 
lection instrument on role involvements of teachers and adminis- 
trators. See Appendix C for a copy of the Guide used in the field 
tests and data collection instruments. 

The Guide items could be perceived as criteria for successful 
installation of innovations although the criteria do not apply 
equally to all situations. Particular innovations were not sug- 
gested by the checklist. Any innovation could be indexed by the 
items, although some of the items may not apply to a particular 
innovation . 



Data Collection . The next activity in the study was to iden- 
tify qualified individuals to indicate the perceived importance 
of the items in the Guide for evaluating an innovation in voca- 
tional and technical education. The U.S. Office of Education 
staff in the Exemplary Programs and Services Branch of the Divi- 
sion of Vocational and Technical Education were a£,F,ed to nominate 
sites of exemplary programs in vocational and technical education 
that have been involved in an exemplary project long enough to 
perceive some of the problems and benefits from its trial instal- 
lation. Staff members engaged in implementing vocational and 
technical education exemplary projects appeared to be qualified 
judges of the importance of the items in the Guide for anticipating 
benefits and installation requirements of an innovation. Four 
sites were selected and visited by members of the research team 
in November, 1971. The names of the project directors and the 
four sites are listed in Appendix D. 

Local project directors were asked to involve all members of 
their staffs who had responsibilities in the exemplary project in 
the data collection. In one case, three consultants from a nearby 
university, a professor and two graduate students, completed an 
appraisal of the Innovations Evaluation Guide but did not complete 
the index of their role tasks since they were not employed by a 
local school. This accounts for a three person discrepancy be- 
tween the number of local administrators completing each instru- 
ment . 
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One of the projects was located in a major metropolitan area, 
one was in a rural area and the two other sites were county units 
adjacent to large cities. A majority of the responses from 
teachers came from individuals in elementary schools since the 
projects all involved career development activities at that level. 
Except for the metropolitan school district, nearly all of the 
teachers and administrators involved in the projects returned 
usable questionnaires. In the metropolitan district only admin- 
istrators and coordinators (with some teaching duties) of the 
exemplary project responded to the data collection instrument. 

When individuals spent more than half of their time in teaching, ‘ 
they were classified as teachers. This same classification system 
applied to administrators. Four guidance counselors in the re- 
spondent group were judged to be administrators for the purposes 
of this study. Four of the individuals in this group were local 
directors of the exemplary project. They could have been classi- 
fied with the local directors attending the national conference, 
but they were not reclassified. 

The responses from the teachers and local administrators 
were collected after school or during their conference period in 
the school day. These situations represented widely varying condi- 
tions and should not be construed as a sample of any kind. The 
attempt was to collect perceptions of the "most important" item 
from individuals best qualified to make this judgment. Figure 2 
shows the respondents by data collection sites. 



Data Collection Site Teachers Administrator s 



County Unit Hi 
County Unit H2 



14 



10 



23 



3 



Metropolitan District 
Rural District 



12 



2 



6 



6 



TOTAL 



38 



38 



Figure 2 



Number of Teachers and Administrators 
by Data Collection Sites 



In addition to local administrators and teachers, responses 
were obtained from state supervisors and local project directors 
of exemplary programs who were attending a national conference in 



December, 1971. Sixty-five usable responses were obtained from 
the 88 people attending the conference. Some left the conference 
before the administration of the instrument. Six others failed 
to complete all of the information. The supervisors and project 
directors were not asked to complete the Role Definition Sheet. 

Revision of the Guide . Following data collection, the re- 
sponses were summarized and analyzed for information leading to 
changes in the Guide. Most of the responses were obtained via 
constructed responses which classified an item in the Guide as 
either "essential" or "helpful" for teachers, administrators, or 
both. Instructions were given for respondents to strike out, 
substitute, or delete any item which needed improvement. In order 
to remain in the Guide, each item had to receive at least 50 per- 
cent "essential" ratings. This was an arbitrary standard estab- 
lished by the research team prior to the data collection. Re- 
spondents also were asked to rate categories of items according 
to criteria of "most important" and "least important." The data 
collection instruments are in Appendix C with the Guide used during 
the field testing. 

Analyses of Data. The data were summarized by frequency count 
according to respondent groups. Appendix Table A-l lists fre- 
quencies for all items in the guide by respondent group and per- 
ceived degree of helpfulness for teachers, administrators, or 
both. Scores for degree of helpfulness for each item were com- 
puted by summing over all categories. The items in Table 1, page 
2 8 ; represent extreme scores (items rated as most essential and 
least essential) . The items were classified as essential for 
whom (teacher, administrator or both) by summing across respondent 
groups and locating the modal frequency as illustrated in Appendix 
Table A-l. 






O 



11 



CHAPTER II 



CONCEPTUALIZATION OF THE GUIDE 



A means of classifying innovations could be useful for a num- 
ber of different activities . Bhola (1965a) states that no worth- 
while taxonomy of innovation is available for use. Even the term 
"innovation" is used synonymously with improvement, invention and 
other terms . He suggests : 

A taxonomy based on operations or processes would have 
been useful but as indicated earlier, it was impossible 
to suggest such a taxonomy with the present inadequacy 
of our knowledge of innovation processes, (p. 14) 

Carlson (1968) would like to have a classification scheme to com- 
pare innovations in discrete studies of diffusion research. An- 
other use for an innovation classification scheme for evaluating 
proposed new ideas is suggested by Stufflebeam and others (1966) . 
They stress the need to eliminate unnecessary duplication of de- 
velopmental effort. A descriptive taxonomy of innovation charac- 
teristics would be a step in this direction. 

THE NEED FOR A CLASSIFICATION SCHEME 

The need for a classification scheme for comparing one inno- 
vation with another is evident. When innovative projects are 
funded by Research Coordinating Units or other agencies in State 
Departments of Education, the justification for the proposal usu- 
ally includes a description of the expected outcomes. For exam- 
ple, the guideline criteria for the evaluation of innovative pro- 
gram applications in the state of New York (1971) contain the fol- 
lowing two items: 

The proposed project is based upon the ideas and prac- 
tices that have shown promise of effectiveness in ex- 
periments or control led ' studies . The project is de- 
signed to demonstrate its effectiveness and efficiency 
within the regular school setting and conducted in a 
reasonably wide range of school settings, (p. 27) 

Most practitioners need help in interpreting the meaning of crite- 
ria such as these. In addition, it becomes important to know which 
characteristics of innovations are of value to potential adopters. 

Orr (1964) notes the biomedical information complex is one 
system which attempts to assist practitioners in their selection 
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d£ innovations and prediction o£ successful performance. Another 
system, Project ALERT developed at the Far West laboratory, pro- 
vides objective, summarized information about tested innovative 
programs and projects in education. The information is placed on 
cards and sorted by grade level, subject area, ability level and 
target audience. This "recipe box" may be used by school admin- 
istrators for information on curriculum decision-making, in-ser- 
vice training, community participation, and so forth. It appears 
reasonable to assume that certain rational information should ac- 
company the promotion of any educational product. But, what is 
the essential information? 

I nformation on the Context . It is unfortunate but true that 
innovations may work very well in one context and fail in another. 
Variations such as the number of teachers involved., in the opera- 
tion of the new idea may be just as important as objective evi- 
dence of increased pupil learning. Miles (1964) supports this no- 
tion when he states: 

. . . educational innovations are almost never installed 

on their merits. Characteristics of the local system, 
of the innovating person or group, and of other relevant 
groups often outweigh the impact of what the innovation 
is . . . (p. 635) 

The researchers found a tendency on the part of the superin- 
tendents interviewed to consider innovations to be system specific. 
One interviewee went so far as to suggest that an idea could not 
be diffused from one school district to another. Ideas are never 
copied; they must be adapted to a school, system. The need for 
data on the conditions under which the innovation was tested was 
emphasized. Information on the assessed evaluation and indebted- 
ness of the district, for example, may determine the amount and 
nature of the finances available for innovation. 

Becker (19 70) states: 

The task of constructing a classification scheme for 
innovations is made more complicated by the need 
(largely ignored by typology-builders) to speculate 
on the possible affective connotations toward the in- 
novations held by members of the system, (p. 271) 

In a study of attributes of innovations as factors in diffusion, 
Clinton and House (197U) found Complexity, relative advantage, 
divisibility, communicability and compatibility to be the best 
predictors for innovation acceptance from among a set of 16 fac- 
tors. In all cases, efficiency was significant as a factor indi- 
cating concern over how well an innovation might work in a respon- 
dent's situation. They concluded that innovation is a mental pro- 
cess followed by a physical act of implementation. 
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In a benchmark study of differential perceptions of innova- 
tions, Kivlin and Fliegel (1966) found perception of innovations 
to be related to adoption. Factors related to cost attributes, 
efficiency, returns, risk and uncertainty, communicability, and 
congruence were examined among dairy farmers in a Pennsylvania 
county. They concluded that ’’additional attributes are needed to 
increase the explained variance . . . Complexity, for example was 

used as a single attribute but may refer to either complexity of 
use or complexity of understanding" (p. 245). A checklist of ques 
tions would be useful in explaining an innovation to a prospective 
adopter . 

A Field Test No Guarantee of Success . Advocates may rely on 
personal experience or persuasion to "sell" an innovation rather 
than supplying potential consumers with field test data. Change 
agents may become overzealous in selling their product to poten- 
tial users. Or, since the economics of marketing do not permit 
time for proper field testing, the direct results or the side ef- 
fects of the products may not be known (Ward and others, 1971). 
Communication needs to be facilitated between the developer and 
the user. 



Even educational products which are tested and proven in an 
ideal environment may fail to perform properly in a real-world 
situation. This was true of an educational device studied by Yens 
(1971). The lack of reliability of the prototypes was the major 
disruptive element. Some writers such as Helwig (1971) reject 
technical efficiency as a means of bringing school systems closer 
to innovation. "Describing the life cycle of a particular innova- 
tion . . . will not tell much about its effectiveness , social or 

otherwise" (p. 83) . He argues for conceptualizing innovation as 
something intrinsic, related to the self-actualizing needs of the 
individual . 

Perhaps it is this critical activity of relating individuals 
to the process of innovation that influenced Lippitt (1968) to 
study internal resistance to innovations as legitimate problem- 
solving. Individuals have to cope with factors within themselves 
before they can commit themselves to new ways of doing things . 

He says, "Usually dissemination agents do an inadequate job of 
helping the potential adopter explore realistically the question: 
'Well, how would this fit in my situation?'" (p. 42) 

Two advocates of performance contracting (Martin and Blaschke 
1971) claim that research and demonstration results in education 
over the last few years have had little impact as they are dif- 
fused throughout the system. They stress the need for changes in 
the way people relate to each other. Staff capabilities become 
crucial to the success of an innovation endeavor. 
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This review has indicated a need for a classification scheme 
for comparing innovations based not only on the characteristics 
of the innovations, but also on their intended consequences in 
the proposed adopting units . The context in which the innovation 
was developed and tested is very much a part of the information 
to be communicated to a prospective adopter. Even then, evidence 
of prior success of the innovation is no guarantee of success in 
the new environment. 



THE SEARCH FOR INNOVATION 

The review of literature and discussions with superintendents 
disclosed a number of curious perceptions of "innovation." At 
least one person equated innovation with political gimmicks. In- 
novations such as voucher plans, performance contracting, and de- 
centralization have nothing to do with educational improvement 
according to this source. There is a world of difference between 
"innovation" on the one hand, and what is actually expected of 
teachers in the classroom on the other hand.^ This discrepancy 
between intended consequences and what actually happens is due, 
in part, to the difficulty in defining a concept of innovation. 

The Problem of Definition . An "innovation" was defined by a 
study conducted by North Central Association of Colleges and Sec- 
ondary Schools and the Institute for Development of Educational 
Activities as "any practice not generally in use in American high 
schools" (Cawelti, 1967, p. 57). In a Michigan study of communi- 
cation networks among innovative schools, the schools were defined 
as ones in which an interest in new ideas and new developments ex- 
ists (1967, p. 5). These definitions provide evidence of the elu- 
sive character of innovation. Trow (1967) captures the spirit of 
innovation with this brief description: 

An innovation is a break with routine and habit; it 
disrupts unreflective ways of thinking, feeling, and 
behaving; it requires a heightened measure of atten- 
tion and interest in the matters at hand; it forces 
the participants, and especially the creators, to 
think in fresh ways about familiar subjects, to re- 
consider old assumptions, (p. 4) 

One of the definitions of innovation which has persisted over 
time has been the notion of innovation as "an idea, practice, or 
object perceived as new by an individual" (Rogers and Shoemaker, 
1971, p. 19). It matters little if an idea is objectively new. 
Presser (1969) points out that an innovation has a point of origin 



^Documented in Education Daily, March 29 , 1971 . 
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in place and time when it is properly considered an invention or 
a new development. An idea is an innovation at different places 
and at different times. Thus, a precise definition of the term 
should include the time and area of its use. 7 



It is not surprising that the search for examples of innova- 
tions in vocational and technical education revealed a number of 
ideas perceived as innovations in one situation, but not in an- 
other. Figure 3 lists some of the more frequent "innovations" 
identified in the literature review. The reader will note the 
wide range of diversity and degree of generality among items. A 
review of innovations in general education (Cawelti, 1967) reveals 
the same diversity of topics. A task force at a national insti- 
tute on innovative curriculums in vocational and technical educa- 
tion (Nelson, 1969) recommended that innovation be viewed "as a 
systematic attempt to redesign educational approaches or practice 
to promote positive curriculum change" (p. 10). As they examined 
innovative programs, the groups found little evidence of unique- 
ness in any one program. It is understandable that many innova- 
tions aim at curriculum improvement as a motivation for planned 
change . 



Innovation Desirability, Most Important . Research on the 
diffusion of innovations has focused much attention on the rate 
of adoption. The study of modern math by Carlson (1965) used the 
rate of adoption as the dependent variable to study the effects 
of certain variables such as social structure in school systems. 
The speed with which an innovation is adopted may have little to 
do with its desirability. Pafford (1968) indicated that the adop- 
tion of the modern math curriculum has weakened the curriculum in 
many districts. Modern math as an innovation is good, but the 
teachers were not qualified to present it effectively according 
to Pafford. This statement emphasized the need to evaluate the 
readiness of a target audience for an innovation. 



"Evidence also indicates," according to Evans (1967), "that 
we should discard from the start any notion that the speed with 
which an innovation is adopted is necessarily related to its use- 
fulness to society as a whole" (p . 16). In fact, an innovation 
which can be adopted easily probably lacks the capacity to make 
a difference in its target audience. An innovation with an abil- 
ity to make a large amoung of change is likely to be adopted rath- 
er slowly. Such innovations are likely to be perceived as threats 
by individuals representing the existing system. 



7The reader may 
innovation score for 
( 1965, pp . 55-56) . 
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1. Accountability 

2. Area vocational schools 

3. Behavioral objectives 

4. Boards of Cooperative Educa- 
tional Services 

5. Cooperative education 

6. Cooperative highway engi- 
neering technology 

7. Cooperative research intern- 
ship 

8. ' Core vocational curriculum 

9. Cost-benefit analysis 

10. Curriculum clusters 

11. Demonstration vocational 
education program for the 
blind 

12. Differentiated staffing 

13. Disadvantaged youth education 

14. Educational T.V. 

15. 8 mm single concept film 
loops 

16. EPDA internships 

17. Exploratory summer programs 
in vocational education 

18. Extended school year 

19. Independent study 

20. Individualized instruction 



21. K-14 career education 

22. Management by objectives 

23. Marine technology program 

24. Micro-teaching 

25. Modular scheduling 

2’6 . 196 8 Vocational Education 

Amendments 

27. Post-secondary education 
for the disadvantaged 

28. Program Evaluation and Re- 
view Technique (PERT) 

29. Program Planning and Bud- 
geting System (PPBS) 

30. Programmed instruction 

31. R$D Centers 

32. Research Coordination Units 

33. Residential schools 

34. Simulation 

35. State Advisory Councils 
for Vocational Education 

36. Statewide computer science 
program 

37. Teacher aides 

38. Teacher decision-making 

39. Team teaching 

40 . Vocational education for 

youth in state correctional 
ins titut e 



Figure 3 

Array of Innovations 
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CHARACTERISTICS OF INNOVATIONS 



Rogers (1962) cautions that innovations * characteristics are 
not absolutes. They vary depending on the mind of the beholder. 
Consistent with this proposition and his definition of innovation, 
Rogers and Shoemaker (1971) have identified five "most important" 
characteristics of innovations which explain much of the variance 
in adoption research studies: 

1. Relative advantage is the degree to which an in- 
novation is perceived as better than the idea it 
superseded . . . 

2. Compatibility is the degree to which an innovation 

is perceived as being consistent with the existing 
values, past experiences, and the needs of the 
receivers . . . 

3. Complexity is the degree to which an innovation is 

perceived as difficult to understand and use . . . 

4. Trialability is the degree to which an innovation 
may be experimented with on a limited basis . .- . 

5. Observability is the degree to which the results 

of an innovation are visible to others, (pp. 22- 23) 

Each of these concepts describes a quality of the innovation 
as it is contrasted with an existing situation. These variables 
represent an interaction between the innovation and a prospective 
adopting unit. 

Other characteristics relate only to the innovation itself: 
the costs of operating the innovation, the time required for plan- 
ning, and so forth (Woods, 1967) . Brickell ( 1969) lists a number 
of general and specific characteristics of innovations: magnitude, 

completeness, complexity, convenience, flexibility, distinctive- 
ness, replicability, content, staff performance, staff background, 
staff roles, social setting, equipment and materials, time, and 
space. He perceives readiness, trial possibility and cost to be 
interaction variables . 

Kivlin and Fliegel (1966) compared initial cost, continuing 
cost, the saving of discomfort and the saving of time, payoff, 
social approval, recovery of cost, divisibility for trial, reg- 
ularity of reward, clarity of results, complexity, compatibility, 
pervasiveness of consequences, and mechanical attraction in their 
study of innovation characteristics. The reader will recall that 
the interaction variables of complexity, relative advantage, di- 
visibility, communicability and compatibility accounted for the 
greatest variation in the Clinton and House (1970) study . There 
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appears to be a need for assessing the anticipated outcomes of an 
innovation in a specific environment. . 

Half of the superintendents interviewed by the authors wanted 
to know the probable consequences of adopting the innovation. 

Would it be acceptable to the teachers and the community? The 
power structure in the community has a lot to do with the imple- 
mentation of an innovation. It can be a barrier or a facilitator 
of innovation depending on the norms which have been built up over 
time. Each superintendent indicated an interest in the cost of 
the innovation and the likelihood of the need for continued sup- 
port. One man indicated that the single most important item which 
determines the acceptability of an innovation was the availability 
of space in which to house it! Funding current programs as well 
as innovations was a problem for all superintendents. The lack of 
local funds and how to get federal and state funds constituted 
high priority information. In other words, a good idea with a 
source of funds usually received more attention than a good idea 
without funds to implement it. 

Most of the superintendents indicated the success of their 
innovations was due to the "initial" impression made on those af- 
fected by the innovation, usually the teachers. The involvement 
of the staff in the planning for an innovation contributed to ac- 
ceptance. Evidence of student learning also helped the success 
of an innovation. Barriers to innovation in school systems seemed 
to be public apathy, the inability to measure the results of change, 
the lack of clear thinking in the planning of an innovation, the 
fears aroused by staff changes, and inadequate organization of the 
school system. 

Both R. I. Miller (1970a) and Kowitz (1971) emphasized the 
importance of improved student learning as a benefit of innovation. 
Miller claims that organizational changes in a school system should 
not be viewed apart from instructional changes. Kowitz wants to 
know how the innovation views the student and the learning process. 
He says the moment of truth for nearly every innovation comes with 
the student's increased learning. 

A cursory review of a few learning packages indicates that 
these products should indicate their level of difficulty, their 
use of resources such as teacher time, facilities and equipment, 
and the goals of the program. Hopefully, the research and devel- 
opment centers and the regional laboratories will begin to publish 
field test data of performance records as a means of providing 
rational information to prospective users . As these data become 
more readily available, potential adopters of education products 
will be more diligent in their search for exemplary innovations. 

At the present time, many educators succumb to the tendency 
to lump all innovations into one basket which oversimplifies and 
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distorts the need for different installation strategies for dif- 
ferent types of innovations (R.T. Miller, 1970b). The introduc- 
tion of an innovation into a scl'tool system or other organization 
poses special problems (Gross, Giacquinta, and Bernstein, 1968): 



Another task of management is to assess the special 
types of problems that can be anticipated to arise 
when different types of innovations are introduced 
into their organizations. Many administrators as- 
sume that all innovations are cut from the same cloth 
and that the same general strategy will fit almost 
any change proposed. They need to give careful con- 
sideration to the unique qualities of a proposed change 
and its implications for planning its implementation. 

(p. 267) 

Clinton and House ( 1970) argue for a special class of innovation 
characteristics related to the feasibility of adopting the inno- 
vation. Undoubtedly, these factors would be similar to the inter- 
action variables mentioned earlier by Rogers; they would relate 
to the consequences of the innovation for the adopting unit. 



One reason for the adoption of inappropriate innovations by 
target audiences is the inability of most educators to define the 
problem adequately. Geis (1968) wants to bring the school into a 
dynamic role with the process of innovation. To make an innova- 
tion work, asserts Geis, the school must spend an enormous amount 
of resources adapting the innovation to its own needs. Some of 
this energy could be spent on a renewal subsystem within the 
school. When a school is not aware of its own needs, innovative 
solutions may be endorsed for the wrong problems. 



The process of assessing school system needs is an arduous 
and time consuming task. The Colorado Department of Education^ 
is granting accreditation to local school districts that undergo 
grueling self-examination. This process, which involves the com- 
munity, is taking two to three years to complete. The purpose of 
such accreditation procedures is to encourage schools to reach out 
for major improvements. 



Assessing the context of an educational program is the sub- 
ject of a publication from the U.S. Office of Education (1970) 
entitled Preparing evaluation reports: A guide for authors. This 

guide suggests several factors which should be evaluated such as 
density of the population, major occupations of people, pupil 



8do cumented in Report on Educational Research , Apri I 28, 1971 
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enrollment trends, per pupil cost of education, and so forth. This 
information would be useful in estimating the effects of a proposed 
innovation on school organization, and pupil growth indicators. 

This overview of characteristics of innovations has described 
some of the more common considerations in the installation of new 
ideas in education systems. These innovation characteristics 
should communicate to potential adopters the benefits and require - 
ments of the innovation. It appears necessary to take into con- 
sideration various strategies for installing innovations into sys- 
tems. Some of the more potent innovation characteristics are, in 
reality, descriptors of the interaction between an innovation and 
its target audience. Hopefully, decision-makers in school systems 
are sufficiently aware of their existing situation to compare the 
proposed change with the status quo or other innovations competing 
for the same resources. The items in the Innovations Evaluation 
Guide in Appendix B represent a synthesis of those characteristics 
identified in the review of the literature. 



Format of the Guide 



The guide contains relatively discrete categories for innova- 
tion characteristics. It can be used by a prospective adopter of 
an innovation to raise questions with its developers or to anti- 
cipate how the new program will fit into the school system (Brick- 
ell, 1969). A decision-maker wanting a record of an innovation's 
costs and results could use the guide to keep such a record during 
tryout of the innovation. The Innovations Evaluation Guide, as 
it is now structured, places emphasis on the benefits and costs 
of the innovation itself, not the speed with which the innovation 
can be adopted. Some attention is given to installation consid- 
erations, particularly potential problem areas such as the reedu- 
cation of staff. The format and content of the Guide is subject 
to change. In fact, the version in Appendix B is a result of 
field tests with four different groups of vocational educators. 



CHAPTER III 



FIELD TEST OF THE INNOVATIONS EVALUATION GUIDE 



The research team visited four exemplary project sites and 
attended a national meeting for exemplary project personnel. This 
provided an opportunity to get input from personnel in the field 
who were involved at different levels in exemplary innovations. 



RATING OF ITEMS IN THE INNOVATIONS EVALUATION GUIDE 

One of the main activities in which all respondents were in- 
volved was the rating of all items in the Innovations Evaluation 
Guide. This involved some decision-making on the part of each 
respondent. Each respondent first decided to whom the item was 
perceived to be of most importance when an innovation is being 
considered. The categories of teacher, administrator, or both 
were offered as choices. 

Selection of the teacher category would indicate that the 
respondent perceived the particular item to be of greatest im- 
portance for teacher consideration. A selection of the both cate- 
gory would indicate that the respondent perceived the item to be 
of equal importance to both the teacher and administrator. A 
choice of administrator indicated the particular item was per- 
ceived primarily as an administrative decision. 

The second decision made by the respondent was an indication 
of the item's perceived importance. The item was rated as either 
"essential" or "helpful." Table A-l in the Appendix contains the 
frequency counts for all items in the Guide by respondent groups 
along with the combined total ratings. A quick scan of the totals 
column in Table A-l will point out that the highest rating in 
some instances does not represent a large number of the 141 re- 
spondents. Some items do, however, indicate strong agreement from 
all respondents . 

i 

Table A-l shows no great variation among the respondent 
groups. It is possible to say that the respondent role did not 
reflect a difference in the overall perception of Guide items. 
Although overall ratings did not represent large variations among 
respondent groups, the following discussion cites examples which 
were outstanding for each of the four respondent groups. 

State Supervisors. State supervisors indicated that 17 of 
the Guide items were not to be considered by the teacher alone. 
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Some rated these items as being of concern to both teacher and 
administrator, but the majority perceived them as being considera- 
tions for the administrator only. A list of the items indicates 
that all items except one are cost items. The one benefit item 
refers to program operations. It can be determined from these 
ratings that state supervisors did not perceive cost items to be 
as much a concern for teachers as they are for administrators. 
These items were: 

1) Increased efficiency, 

2) Costs, 

3) Sources of dollars, 

4) Availability of dollars, 

5) Proportion of dollars available from different sources, 

6) Limitations on use of other than local funds, 

7) Acceptance, 

8) Policy changes, 

9) Feasibility, 

10) Effect on staff organization, 

11) New relationships among groups, 

12) Quantity of staff, 

13) Space (Housing), 

14) Space (Land use) , 

15) Arrangement of space to other programs, 

16) Acquisition of needed space, 

17) Hardware. 

Two Guide items did not receive any responses as considera- 
tion just for the administrator. These were increased rate of 
learning and increased scope of learning. The majority of state 
supervisors perceived these to be basically essential to both 
teacher and administrator. 

Items which received the least number of essential responses 
were cyclical considerations, divisibility, and new relationships 
among groups. These ratings are probably due to the limited in- 
volvement in actual exemplary program operations by state super- 
visors . Neither would they be as concerned about group relation- 
ships since they are not involved directly in program operations. 

State supervisors rated the following items most frequently 
as being essential: 

1) Availability of dollars, 

2) Quantity of staff, 

3) Costs, 

4) Complexity. 

Local Administrators . Local administrators perceived seven 
of the items as not being considerations for the teacher only. 
These items were: 
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1) Sources of dollars, 

2) Availability of dollars, 

3) Proportion of dollars available from different sources, 

4) Policy changes, 

5) Quantity of staff, 

6) Arrangement of space to other programs, 

7) Acquisition of needed space. 

In all cases, the majority felt these items were considerations 
for the administrator only. This reaction could have been pre- 
dicted from local administrators since the items relate to cost 
and to responsibilities usually borne by administrators. 

Items which received the least number of essential responses 
from local administrators were: 

1) New relationships among groups, 

2) Economic and social efficiencies, 

3) Proportion of dollars available from different sources, 

4) Entry and advancement in an occupation, 

5) Cyclical considerations, 

6) Divisibility. 

The above list tends to indicate that local administrators 
are not always as concerned with aspects which would concern the 
director of the project or teachers involved in the project. 

This also might be due to being somewhat removed from the actual 
project operations. 

The following items were rated essential most frequently by 
local administrators: 

1) Availability of dollars, 

2) Quantity of staff, 

3) Policy changes. 

Local Project Directors . Local project directors rated four 
of the Guide items as not being considerations for the teacher 
only. These were: 

1) Installation time, 

2) Policy changes, 

3) Degree of development, 

4) Feasibility. 

The majority felt that policy changes were administrative 
considerations only. The other three items were rated as essen- 
tial to both the teacher and administrator. 

The items to which this group gave the least number of essen- 
tial responses were: 
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1) Reliability, 

2) Increased rate of learning, 

3) Economic and social efficiency, 

4) Divisibility. 

One respondent admitted that reliability was not important 
to know if they were sold on trying out an innovation locally. 

Local project directors rated the following items most fre- 
quently as being essential: 

1) Personal human values, 

2 ) New roles for individuals, 

3) Teaching or other experience. 

Local Teachers . Sources of dollars and proportion of dollars 
available were not perceived by this group to be considerations 
for the teacher only. 

Items to which teachers gave the least number of essential 
responses were: 

1) New relationships among groups, 

2 ) Entry and advancement in an occupation, 

3) Cyclical considerations, 

4) Economic and social efficiencies, 

5) Reliability, 

6) Acceptance, 

1 ) Divisibility. 

A large number of respondents were elementary teachers. For 
this reason they might not be particularly concerned with such 
items as entry and advancement in an occupation or economic and 
social efficiencies. Divisibility again received the least number 
of essential responses. This item and cyclical considerations 
appear to be relatively unimportant considerations for exemplary 
proj ec ts . 

Items which were rated essential most frequently by teachers 

were : 

1) Costs, 

2) Space (Housing) , 

3) Sources of dollars, 

4) Complexity, 

5) Disruption of routine, 

6) Hardware . 

Items Perceived as Most and Least Essential . It was possible 
to determine which Guide items were perceived’ as the most and 
least essential by analyzing the combined frequency counts for 
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all four respondent groups. Items were listed which appeared at 
either extreme according to high and low essential frequency counts 
The natural break was used as a cut-off point in determining which 
items would be listed. For example, the items next to complexity, 
operation time and personnel development, had frequency counts of 
113 and 112 respectively. Items next to increased rate of learn- 
ing, degree of development and acquisition of needed space, had 
frequency counts of 93 and 94 respectively. 

Table 1 includes only those Guide items which received the 
most and least frequent combined essential responses. These items 
are listed by individual respondent group as well as by the com- 
bined totals for all respondent groups. Table 1 allows a com- 
parison of item perceptions among respondent groups. The propor- 
tion of respondents rating items as essential can be determined. 

For example, of the 30 state supervisors, all 30 rated availability 
of dollars essential. Twenty-nine rated quantity of staff essen- 
tial. In the local administrator group, 33 of the 38 rated these 
same two items essential. Four items tied as first choice of the 
local project directors with an essential response from 30 out of 
35. The highest essential ratings from teachers were 33 out of 
38 for costs and housing space. 



RANKING OF SUBHEADINGS IN THE INNOVATIONS 
EVALUATION GUIDE 

The Innovations Evaluation Guide is composed of two main 
divisions, benefits and costs. Each division includes several 
subheadings. Under each subheading are the individual items which 
are presented for consideration when an innovation is being eval- 
uated , 

Upon completion of ratings for all the individual items, 
respondents were asked to rank order the subheadings. Each re- 
spondent ranked only six of the 11 subheadings. The instructions 
were to rank the three most important subheadings with "1" for the 
most important, "2" second most important, and "3" third most 
important. The least important subheadings were ranked "11" for 
the least important, "10" second least important, and "9" third 
least important. Those subheadings which were not ranked either 
most or least important were left blank. Table 2 includes the 
mean rankings for the Guide subheadings on a scale of +3 for the 
highest rank down to -3 for the lowest. 

State Supervisors . Subheadings considered least important 
in order from high to low by this group were organization change, 
space requirements and equipment requirements. The items under 
these subheadings are not considerations of high priority to state 
supervisory personnel. 
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Table 1 



Number of Persons Indicating an "Essential 
Most Frequent and Least Frequent 



" Response for 
I terns 



Total # of 
Respondents 
(N- 14 1 ) 



State 

Supervisors 

(N=30) 



LEA 

Adm inis- 
trators 
(N=38) 



Local 
Proj ec t 
Directors 
(N=3 5) 



LEA 

Teachers 
(N = 3 8) 



MOST ESSENTIAL ITEMS 



Quantity of staff 


121 


29 


33 


30 


29 


Costs 


119 


27 


29 


30 


33 


Availability of dollars 


119 


30 


53 


27 


29 


Space (Housing) 


119 


25 


31 


30 


33 


Lead Time 


117 


28 


29 


30 


31 


Sources of dollars 


117 


26 


31 


28 


32 


Hardware 


116 


25 


31 


28 


32 


Complex ity 


115 


28 


29 


2b 


32 



LEAST ESSENTIAL ITEMS 
Increased rate of 



learn i ng 


87 


19 


27 


21 


20 


Entry and advancement 


in an occupation 


86 


21 


21 


24 


20 


New relationships 


among groups 


83 


15 


22 


28 


18 


Cyclical Considerations 


83 


16 


19 


26 


22 


Economic and social 


efficiencies 


81 


22 


15 


23 


21 


Rel iabi 1 i ty 


79 


22 


21 


16 


20 


Divis ibi li ty 


72 


15 


21 


17 


19 



Note: The above list represents those Guide items at either extreme separated at the 

natural breaks. 
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The subheadings which they considered most important were 
individual pupil growth, key indicators of innovation success, 
and funding. I terns under these subheadings point to the concern 
of state supervisors for successful programs which serve the needs 
of students. Their position in vocational education is probably 
the reason for being the only respondent group ranking key in- 
dicators of innovation success in the top three. 

Table 2 reveals that this -was the only group giving a minus 
mean ranking to program operations. Limited involvement in actual 
program operations may account for this ranking. 

Local Administrators . This group considered the least im- 
portant subheadings to be space requirements, equipment require- 
ments, and organization change. These items appear to be impor- 
tant considerations for local administrators to rank low, but 
many innovations do not require additional space and equipment 
nor a change in the organization. They chose other items to be 
more important than these items. 

Their highest rankings of subheadings were individual pupil 
growth, funding, and personnel needs. We again see a concern for 
programs of benefit to students and a concern for funding. This 
group was concerned more with personnel needs than any other. 

The local administrative group was the only group to give a 
minus ranking to the subheading of legitimacy of the innovation. 

Local Project Directors . Space requirements, equipment re- 
quirements, and installation considerations were ranked least 
important in this order by project directors. Again, these might 
not be common considerations for many innovations. Of greatest 
concern to this group were individual pupil growth, funding, and 
^program operations. It appears that this group differs from the 
others in their concern for program operations. 

It is interesting to note that this was the only group to 
have a minus mean ranking for key indicators of innovation suc- 
cess. This could be due to the orientation of the respondents. 
Many of the local director s were involved in career education pro- 
grams which were not directly concerned with such things as pre- 
paring students for entry and advancement in an occupation. 

Local Teachers . Subheadings ranked as least important were 
installation considerations, equipment requirements, and organiza- 
tion change. Teachers considered these not to be of as great a 
concern as individual pupil growth, funding, and program opera- 
tions. They seem to share the same concern as local project di- 
rectors. This is probably due mainly to their involvement in 
operating the innovation. 
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Mean Rankings for. Guide Subheadings by Respondent Group 



CO 
























rH p / — n 




to 


rH 


O 


o 


M* 


M- 


cn 


M* 


to 


*d- 


cd CD 00 


rH 




im 


o 


o 


rH 


rH 


CM 


rH 




rH 


O rd tO 
O U II 


to 


to 


rH 


CM 


*d- 


L0 


cr> 


VO 


to 


to 




rt 2 
U v_/ 


CM 


o 


O 


o 


o 


o 


O 


o 


O 


o 


O 


E-h 












\ 


1 


t 


l 


i 


1 


CO 
























P P 
























H U O / — n 


to 


o 


0\ 


SO 




to 




to 


to 


to 


•H" 


d) -M LO 


cn 


LO 




to 


un 


cr> 


o 


cn 


M* 


cn 


rH 


U *r-» L) tO 
0 O (D II 


to 


CM 


rH 


o 


«o 


to 


vO 


to 


rH 


to 


CM 


p ! . .-4 


cm 


o 


O 


o 


rH 


o 


O 


o 


O 


r— 1 


rH 


Q 






1 






1 


l 


1 




1 




i tn 
























H (/) Jh y'— \ 


to 


o 


O 


o 


CO 


r^ 


o 


rH 


O 


O 


to 


Cd *H O 00 


*d- 


o 


o 


o 


CM 


LO 


o 




o 


O 




0 d P to 
0 *H 03 II 




CXI 


CM 


CM 


CM 


vO 


vO 


r-- 


00 


o 


c n 


P £ P £ 

rr-t .!_) V / 


rH 


o 


o 


o 


rH 


O 


O 


o 


o 


rH 


o 


T- 

< 








1 




l 


l 


i 




1 


i 


CO 
























P 
























O 
























CD CO t~\ 






o 


cr> 


00 


00 


IN 


to 


CM 


to 


LO 


P *H O 






o 


vO 


o 


to 


vO 


CM 


vO 


CM 


rH 


03 > K) 
P P || 


o 


o 


o 


CM 


00 


LO 


M* 




H* 




vjD 


CO CD Z 

QA i 


CM 


o 


rH 


o 


o 


o 


O 


rH 


O 


rH 


O 


r - H 

d 




1 








1 


1 


1 




1 


1 


CO 






























(0 
























(0 






(0 




CD 












CO 


CD 






G 




bO 




CO 




to 




d 


4H U 


CD 




p 




d 




p 




bo 

f*4 


rH 


o 


0 o 


Xl 




♦ H 


to 


cd 




d 




G 


•H 


♦H 


.0 


P 




P 


d 


Hd 


to 


CD 




•H 


Ph 


P 


(0 CO 






cd 


0 


CP 


T3 


6 


CO 


T3 


d 


cd 


M 


CM 






•H 




0 


CD 


p 


cd 


d. 


p 


0 d 


o G 




CD 


d p 


d 


0 


P 


d 


0 

H 




CD 


4-> 0 


0 




T3 


o cd 


o 




•H 


CD 


rG 


rH 


Oh 


Cd *H 


>s»H 




•H 


•H M 


•H 




d 


& 


X) 


03 


o 


O 4-> 


U P 




(0 


P 0 


P 


rH 


cr 


P CD 




P X! 




•H cd 


cd cd 




d 


cd tJ 


cd 


0 


CD 


d p 


CO 


T3 P 


& 


TJ > 


£ > 


bo 


0 


rH *H 


N 


d 


04 


0 »H 


0) 


•H £ 


cd 


d o 


•H 0 


d 


u 


rH t0 


•H 


d 




6 d 


> o 


P 


M G 


p G 


•H 




cd d 


d 


o 


CD 


Ph a 


T3 


•H P 


bO 


G 


•h g 




0 


P 0 


cd 


(0 


a 


•H 0 


• H 


'd CJ 


O 




bOhH 


p 


6 


CO U 


bo 


u 


cd 


d c* 




d 


P 


CD 


(D 


3 


• H 


d 


P 


0 


P. 


O' 


CO 


h— 1 


Oh 




P 


CL, 


H 


hH 


O 


a. 


CO 


w 



ERIC 38 



Note: Subheadings were ranked +3, +2, +1 as highest values respectively, 

and -3, -2, -1 as lowest values respectively. 



The personnel needs subheading received a positive mean rank- 
ing from all groups except local teachers. This points out their 
feeling that this is more of an administrative concern. 

Comments on Overall Ranking of Subheadings . Individual pupil 
growth was ranked the most important subheading by all groups. 
Funding was ranked the second most important by all groups except 
the state supervisors who selected key indicators of innovation 
success. Program operations was third most important to local 
project directors and teachers whereas state supervisors selected 
funding and local administrators selected personnel needs. 

There was also agreement among the respondent groups concern- 
ing those subheadings that were least important of the 11. These 
were space requirements, equipment requirements, organization 
change, and installation considerations. 

The variation that exists in the ranking of the subheadings 
can be attributed to the role of the respondent groups. For ex- 
ample, state supervisors are not usually directly involved in 
program operations under their jurisdiction. Their concern for 
funding is not of the same nature or as the concern of local ad- 
ministrators or local project directors. An example of the unique 
priorities of the teacher group would be their low concern for 
funding and personnel needs as compared with local administrators 
and local project directors. 



RELATIONSHIP BETWEEN RATING OF ITEMS 
AND RANKING OF SUBHEADINGS 

The degree of difficulty involved in rating individual items 
and ranking subheadings of the Innovations Evaluation Guide was 
not the same. Guide items were considered and rated on an indi- 
vidual basis. After completing the individual item ratings, re- 
spondents were then asked to rank order the subheadings. 

Of the 11 Guide subheadings, only the three most important 
and the three least important subheadings were ranked. This meant 
that a decision had to be made not to rank five subheadings. 

Many respondents found this activity to be most difficult 
due to the need to consider collectively all the items which were 
contained in each subheading. In fact, some respondents would not 
rank order the items and recorded reasons for not doing so which 
appear later in this report. 

Some relationship can be cited in the rating of items and the 
ranking of subheadings. These are as follows: 
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The high ranked subheading funding includes the most essen- 
tially rated items of costs, availability of dollars, and 
sources of dollars. 

The high ranked subheading personnel needs includes the most 
essentially rated item quantity of staff. 

The low ranked subheading organization includes the least 
essentially rated item of new relationships among groups. 

The low ranked installation considerations subheading contains 
the least essentially rated item of cyclical considerations. 



DESCRIPTION OF LOCAL ADMINISTRATORS AND TEACHERS 

Respondents were clustered according to how they spent their 
time during the school day. Three broad categories were listed 
in which each person provided the percent of time spent in each. 
These categories were teaching, administrative duties, and coun- 
seling students. 

Four full-time guidance and counseling respondents, four 
university respondents, and one vocational cooperative teacher were 
included in the administrative category. This number did not 
merit setting up a separate category, and it was felt that these 
individuals would identify more wi-h administrators than with 
teachers in decision-making. 

Local Administrators . The 38 local administrators represented 
many positions within the local school district operating the 
exemplary project. Titles appearing on data forms were principal, 
specialist, counselor, director, coordinator, job developer, super- 
intendent, supervisor, and vocational cooperative teacher. 

The mean age for local administrators was 44.2 years with a 
mean of 15.5 years experience in the field of education. Sixteen 
of the 38 had been in their present position for four years or 
more . 



Eight of the administrators indicated that a percentage of 
their day was spent in guidance and counseling activities. 

Local Teachers . The most common title found on the 38 teacher 
response forms was that of classroom teacher. Other titles in- 
cluded career or occupations teacher, teacher coordinator, remedial 
teacher, team room teacher, and consumer education teacher. 

Mean age for teachers was 3b. 8 years, and mean years experi- 
ence was 14.3 years. Eleven of the 38 had less than three years 
of experience. 



Fifteen teachers indicated a percentage of their time during 
the day was spent in counseling. Six teachers indicated a small 
percentage of their day was spent in administrative duties. 

Professional Activities and Academic Preparation . All local 
administrators and 30 of the 38 teachers held membership in pro- 
fessional organizations. A majority of each group were members of 
state organizations. Local organizations claimed the second high- 
est number of memberships followed by national organizations. Al- 
though membership in professional organizations was high, only 
nine teachers and nine administrators held an office. 

All respondents indicated they held a degree of some type. 

Five teachers checked the master's degree and three the specialist. 
Twenty-six administrators had a master's degree, four wore special- 
ists, and one project director had a doctorate. 

Description of Local Project Directors and State Supervisors . 
The mean age for proj ect directors was 4 0.9 years. Mean years 
experience in education was 16.1 years with 2.8 years average 
tenure in their present position. State supervisors had less 
tenure in their present position than any other category. Twenty- 
seven of the 35 indicated less than three years. The mean age 
for this group was 38.3 years. The average years of experience 
in education was 14.3 years. 



ROLE DEFINITION INFORMATION FOR LOCAL 
ADMINISTRATORS AND TEACHERS 

It was anticipated that involvement in various school-related 
activities would influence teacher and administrator perceptions 
of Guide item importance. For this reason, an instrument was de- 
signed to define respondent role by categories of school and re- 
lated activities. See sample form in Appendix C. 



Respondents were asked to place a check on the Role Definition 
Sheet beside each item which defined their role in the school sys- 
tem. This information was used in two ways. First of all, it 
allowed a comparison of teachers who were involved in certain 
activities to those who were not involved. A comparison was also 
possible between the teacher and administrator groups. 



The following discussion on 
teacher role definition is taken 



local administrators and local 
from Table A-2 in the Appendix. 



Class Scheduling . Half of the 38 teachers and 22 of the 35 
administrators checked that they were involved in this activity. 

Pur chasing . Twenty-one teachers and 27 administrators were 
involved m purchasing either items of equipment or expendables 
such as general supplies. 
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Extra Duties . Over half of the teachers indicated they had 
extra duties such as lunchroom, hall, bus, or some other. Less 
than half of the administrators checked involvement in this item. 

Curricu lum Planning . All of the administrators were involved 
in curriculum planning at some level. Twenty-six teachers indi- 
cated involvement. Teachers checked department planning most fre- 
quently. Administrators checked involvement at all levels with 
the greatest responses to total school and department planning. 

F inancing . Only three teachers, as compared to 19 adminis- 
trators, were involved in such activities as setting up budgets. 

For teachers, involvement was on the department level; adminis- 
trators checked total school and department levels most frequently. 

Implementing Programs and/or Projects . All administrators 
and 21 teachers checked this item. The highest frequency for 
teachers was in the department category. A majority of adminis- 
trators checked total school, followed by department and inter- 
school . 

Administrative Services. Almost half of the teachers checked 
involvement , with the largest number being in committee work. 
Twenty-nine administrators were involved, with 25 checking plan- 
ning. 



Hiring . Of the four teachers involved, two help make the 
hiring decision. All of the administrators at least make hiring 
recommendations. Of the 25 involved, 18 interview and 15 make the 
hiring decision. 

Related School Tasks . Sixteen teachers and 11 administrators 
indicated involvement in such activities as yearbook committee, 
coaching, club sponsor, or other. 

Formal Representative Of . Twenty-five teachers and all of 
the administrators checked that they were a formal representative 
of some group within their education system. Sixteen teachers 
represented their own position while 10 were representatives of 
teacher groups. Administrators checked all categories, with the 
largest number checking school, department and own position. 

A majority of teachers and administrators indicated they were 
representatives to parents. Teachers also indicated representation 
to other teachers and professional organizations. Administrators 
also checked representation to central administration, teachers, 
community organizations, and the school board. 

The teacher group felt its representation was mainly to re- 
port grades and explain school programs. Administrator representa- 
tion was mainly for explaining school programs, coordinating 



curriculum within the school, and gaining support for school pro- 
grams . 



EFFECT OF ROLE INVOLVEMENT ON ITEM RATINGS 

Supervisors and local project directors did not complete the 
role involvement form. Table 3 shows teachers and administrators 
grouped together. They were divided on the basis of whether or 
not they were involved in a particular role definition category. 

In the first role category, an average of 29 respondents who were 
involved in class scheduling marked Guide items as essential. 

Those not involved in class scheduling numbered 35 with an average 
of 24 marking all Guide items essential. 

The proportion of respondents who marked items as essential 
was calculated for those involved and not involved in each role 
category. The difference between these two proportions represents 
the difference in marking items essential based on role involve- 
ment . 



A look at some of the proportion figures indicates no signif- 
icant response pattern existed. Marking items essential was not 
always a characteristic of those who were involved. The greatest 
difference between those involved and not involved was in the pur- 
chasing role category. It should be noted that a greater propor- 
tion not involved in purchasing tended to rate Guide items essen- 
tial than those involved. The categories of implementing programs 
and administrative services did not have a difference. 



CHANGES MADE IN INNOVATIONS EVALUATION GUIDE 

In addition to rating all the Guide items and ranking the 
Guide subheadings, all respondents were asked to make verbal and 
written comments. Instructions were given to mark out any item 
which they felt should not be included to change the wording of 
any item for easier understanding, or to write in any item which 
should be included but had been omitted. 

All written and verbal responses were considered in revising 
the Guide items. Respondents offered written suggestions on the 
rating form or on the Guide itself. Verbal comments were not many 
in number since the circumstances under which the data were gath- 
ered did not allow the necessary time for individual contact with 
respondents . 

Deletion of Items. Although instructions were ?iven to mark 
off any item which should not be evaluated, none were deleted from 
the Guide in this manner. 
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Table 3 
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The Effect of Teachers' and Administrators' 
Role Involvement on the Rating of the Items 



Role Involvement 



N* 



Proportion of 

Average Frequency for Respondents who 
all items marked marked items as 
as essential** essential Difference 



Class Scheduling 
I nvolved 
Not Involved 

Purchasing 

Involved 
Not Involved 

Extra Duties 
I nvolved 
Not Involved 

Curriculum Planning 
Involved 
Not Involved 

F inane i ng 

Involved 
Not Involved 

Implementing Programs 
Involved 
Not Involved 

Administration Services 
Involved 
Not Involved 

Hiring 

Involved 
Not Involved 



involvement . 



41 


29.10 


.71 


35 


23.68 


.68 


48 


32.57 


.67 


28 


20.21 


.72 


38 


25.76 


.67 


38 


27.02 


.71 


59 


41.31 


.70 


17 


11.47 


.67 


22 


15.92 


.72 


54 


36.86 


.68 


53 


36.76 


.69 


23 


16.02 


.69 


46 


31.97 


.69 


30 


20.81 


.69 


29 


19.89 


.68 


47 


32.89 


.69 


'S and 


teachers are 


included in this 


. items 


in the Innovations Evaluation 



,03 



.05 



.04 



,03 



,04 



.00 



,00 



.01 
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The following comments were written by respondents: 

"It is difficult to rate - all are necessary - I answered to 
the best of my feelings." 

"I feel that each element listed is of critical importance 
at some time in the planning and implementing stages of the 
specific innovation. I cannot, in proper context, consider 
any of the above items to be 'least' important." 

"I disliked the chore of ranking the three least important 
items. They are all critical." 

An arbitrary figure of 50 percent was set as a point at which the 
deletion of items would be made. This meant that any Guide item 
rated as essential by 50 percent or less would be deleted. Total 
responses indicated that all items were rated as "essential" by 
at least 50 percent of the respondents. 

Addition of Items . The following items were added to the 
Guide : 

1) Community involvement, 

2) Warranty, 

3) Operational assistance, 

4) Planning time, 

5) Adaptability . 

Most Of the original benefit items related to the student. 

It was pointed out that benefits could accrue to the school and 
community as well as to the student. Warranty and operational 
assistance were added under the new subheading Beneficial Charac- 
teristics of the Innovation. These items focus on such questions 
as who is responsible for assuming success and what services are 
provided in the installation of an innovation. Planning time was 
added as a separate item in order to allow consideration for plan- 
ning prior to and after installation. Adaptability was f'elt to 
be another separate item since the item degree of development did 
not clearly include this consideration. 

Changing of Items . After considering the suggestions which 
had been offered by respondents and other persons interested in 
this Guide, the research team made additional corrections to the 
Guide . 



Most of the changes involved rewording for clarification of 
the meaning of the item. Other changes involved two Guide sub- 
headings which did not clearly identify the items they contained. 

The revised Innovations Evaluation Guide is in Appendix B. 
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CHAPTER IV 



FINDINGS, IMPLICATIONS, AND RECOMMENDATIONS 

This study of innovation diffusion focuses on the process of 
accepting or rejecting innovations. A scheme for classifying in- 
novations was attempted, which led to the development of a guide 
for evaluating innovation characteristics. The Guide contains 
questions which explain each evaluative criterion. The items in 
the revised Guide were perceived to be "most essential" for eval- 
uating innovations . 

After a comprehensive search of the literature for taxonomic 
dimensions which describe innovations, interviews were held with 
six superintendents of school districts and others in the state 
of Ohio. The interviews assessed the context of administrative 
needs and "tested" the validity of Guide items gleaned from the 
literature. A prototype of the Innovations Evaluation Guide was 
pilot tested in a junior high school and revised before the field 
test. Staff members of vocational education exemplary programs 
in four local sites evaluated the helpfulness of the Guide’s items 
for assessing innovation. In addition, state supervisors and lo- 
cal project directors of exemplary programs evaluated the Guide 
items. The appended Innovations Evaluation Guide was revised 
based on the field test data and other suggestions from respon- 
dents . 

FINDINGS 

1. A comprehensive taxonomy which classifies discrete vocational- 
technical innovations into mutually exclusive categories was 
not possible with our present level of knowledge and technol- 
ogy. 

2. It was possible to develop a guide with logical intradependent 
categories which were perceived as essential to the evaluation 
of innovations . 

Items Most Essential^ 

2.1 Items rated as most essential by all respondents were the 

following: Quantity of staff, Costs, Availability of dollars, 



^Finding's 2.1 and 2.2 refer to data in Table I. These items 
are the ones rated "essential" most frequently and least frequently 
by all res pondents . 




46 



39 



Space (Housing), Lead time, Sources of dollars, Hardware, 
and Complexity. 



2.2 Items rated as least essential by all respondents were the 
following: Rate of learning, Entry and advancement in an 

occupation, New relationships among groups, Cyclical consid- 
erations, Economic and social efficiencies, Reliability, and 
Divisibility . 



Person to Make Decisions * 0 

2.3 Except for the item on efficiency, all items classified as a 
benefit in the Guide were rated most frequently as "essen- 
tial" for both teachers and administrators. The items are 
Rate of learning, Scope of learning, Attitude, Effectiveness, 
Entry and advancement in an occupation, Economic and social 
efficiencies, Personal human values, Validity, and Reliabil- 
ity . 

2.4 The following cost items were rated most frequently as "es- 
sential" for both teachers and administrators: Lead time, 

Installation time , Operation time, Cyclical considerations, 
Acceptance, Complexity, Divisibility, Degree of development, 
Feasibility, Disruption of routine, New roles for individuals, 
New relationships among groups, Teaching or other experience, 
Personnel development, Hardware, and Software. 

2.5 The following items were rated most frequently as "essential" 

for administrators only : Costs, Sources of dollars, Avail- 

ability of dollars, Proportion of dollars available, Limita- 
tions on uses of dollars, Policy changes, Effect of innova- 
tion on staff organization, Quantity of staff, Space (Housing), 
Space (Land Use), Arrangement of space to other programs, and 
Acquisition of needed space. 

2.6 No items were rated most frequently as "essential" for teach - 
ers only . One item, "Time allocated for operation of the 
innovation," received a large number of "essential" ratings 
for teachers only. 



I^The clarification of a Guide item as "essential" for a 
particular role (e.g., teacher, administrator, or both) was based 
on the modal response of the particular sample group as illustrated 
in Appendix Table A - I . 
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Respondents* Perceptions 



2.7 0£ the items rated as most essential, teachers tended to 
give the "Quantity of staff" item lower ratings than super- 
visors, local administrators, or project directors. 

2.8 State supervisors, local administrators, local project direc- 
tors, and local teachers held similar perceptions of the im- 
portance of the Guide items. 

2.9 Involvement in school -related tasks had no effect on per- 
ceived importance of Guide items. 

Implications 

1. The large number of items in the Guide perceived to be 

important for the administrator only or the administrator in con- 
cert with teachers suggest the need for change agents to clear 
decisions with the administrator of the program. The administra- 
tor should be perceived as the point of entry for external change 
agents into an educational agency. In most cases, the administra- 
tor more likely to be a decision-maker in the selection of the 
innovation than a teacher. • 

2. The almost unique concern of the administrator for costs 
and sources of final support suggests that innovations Kith finan- 
cial benefits to the school system are more likely to be of inter- 
est to administrators than innovations with increased costs. 

3. The desirability of an innovation should be based on the 
value added to the educational system by its adoption, not on its 
ease of installation. 



RECOMMENDATIONS 

1. Change agents, both internal and external to the organiza- 
tion, should use the Guide to evaluate innovations being proposed 
or tried by the organization. 

2. The Guide should be validated with documentary studies 
of specific products to determine the effectiveness of the guide 
in practice. 

3. Assistance should be provided to local administrators for 
assessing school system needs in a manner and format which will 
facilitate the comparison of potential solutions to identified 
problems . 
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Table A- 1 

Summary of Essential and Helpful Responses to All Guide Items by Respondent Group 
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Table A-2 



Role Definition Sheet 



,LI : A LEA 

Teachers Administrators 

(N=38) (N=35) 



Categories 


Not 

Involved 


I nvo 1 ved 


Not 

Involved 


Involved 


In School Role Duties 

a. Class Scheduling (i.e., deter- 
mining number of students in 
class and time/place of class) 


19 


19 


s 

13 


22 


b. 


Purchasing 


17 


21 


8 


27 




1. Equipment (i.e,, overheads, 
tape recorders, etc.) 


21 


17 


9 


26 




2. Expendables (i.e., general 
supplies, Eext books) 


22 


16 


8 


27 


c . 


Extra Duties (i.e., bus, lunch 
room, hall , etc.) 


15 


23 


20 


15 


ti. 


Curriculum Planning 


12 


26 


2 


33 




1. Department 


13 


25 


15 


20 




2. Interdisciplinary 


34 


4 


21 


14 




3. School (total) 


35 


3 


12 


23 




4. Inter-school 


37 


1 


21 


14 




5. District 


38 


0 


27 


8 




6. State 


38 


0 


31 


4 




7. National 


38 


0 


34 


1 




8. Other (specify) 


37 


1 


32 


3 


e . 


Financing (setting up budgets) 


35 


3 


16 


19 




1. Department 


36 


2 


25 


10 




2. School (total) 


38 


0 


23 


12 




3. District 


38 


0 


33 


2 




4. Other (specify) 


37 


1 


34 


1 


f . 


Implementing Programs and/or 
Pro j ects 


17 


21 


3 


32 




1. Department 


20 


18 


19 


16 




2 . Interdiscipl inary 


35 


3 


26 


9 




3. School (total) 


33 


5 


13 


22 




4. Inter-school 


36 


2 


20 


15 




5. District 


38 


0 


29 


6 




6. State 


38 


0 


32 


3 




7. National 


38 


0 


33 


2 




8. Other (specify) 


38 


0 


35 


0 


g. 


Administration Services 


21 


17 


6 


29 




1. Planning (specify) 


36 


2 


10 


25 




2. Committee Work 


22 


16 


11 


14 


h . 


Hiring 


34 


4 


10- 


25 




1. Interviewing 


36 


2 


17 


18 




2. Recommending 


36 


2 


10 


25 




3 . Deci s ion -Making 


36 


2 


20 


15 



Note: Three university respondents were included in the administrator category. 

These three did not complete the Role Definition Sheet but are listed as 
not involved in the role categories. 
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Table A-2 (Con't) 



LEA 

Teachers 

(N=38) 



LEA 

Administrators 

(N=35) 



Not 

Categories Involved 


Involved 


Not 

Involved 


I nvolved 


Related School Tasks 


22 


16 


24 


11 


a. Yearbook Committee 


38 


0 


31 


4 


b. Coaching (specify) 


37 


1 


32 


3 


c. Club Sponsor (specify) 


33 


5 


31 


4 


d. Other (specify) 


28 


10 


31 


4 


Formal Representative Of: 
a . Who 


13 


25 


3 


32 


1. Teacher group (specify) 


28 


10 


27 


8 


2. School 


33 


5 


20 


15 


3. Department (specify) 


33 


5 


23 


12 


4. Students 


35 


3 


27 


8 


5. Own Position 


22 


16 


25 


10 


6. School District 


37 


1 


28 


7 


b. To Whom 


15 


23 


4 


31 


1. Other teachers 


29 


9 


22 


13 


2. Central Administration 


32 


6 


18 


17 


3. Other principals 


37 


1 


27 


8 


4. Parents 


21 


17 


14 


21 


5. Business 


36 


2 


24 


11 


6. Community Organizations 


35 


3 


23 


12 


7. School Board 


37 


1 


23 


12 


8. Professional Organizations 
(speci fy ) 


30 


8 


29 


0 


c. For What Purpose 


11 


27 


5 


30 


1. Reporting grades 


19 


19 


27 


8 


2. Explaining school programs 
( Information) 


24 


14 


9 


26 


3. Gaining support for school 
programs 


33 


5 


17 


18 


4. Curricular Coordination within 
the school 


31 


7 


13 


22 


5. Curricular Coordination between 
schools within the district 


33 


5 


22 


13 


6. Representation Purposes (i.e., 
voting, discussion, etc.) 


36 


2 


31 


4 


Professional Activities - Give names of 
organizations. You may abbreviate, 
a. Membership 


8 


30 


3 


32 


(local) 


10 


28 


10 


25 


(state) 


9 


29 


4 


31 


(national) 


17 


21 


15 


20 


b. Activity Offices Held 


29 


9 


26 


9 


Academi c Preparation 


4 


34 


1 


34 


a* No degree 


28 


0 


35 


0 


b. Bachelors (specify areas) 


5 


33 


11 


24 


c. Master (specify areas) 


33 


5 


9 


26 


d. Specialist (specify areas) 


35 


3 


31 


4 


e. Doctorate (specify areas) 


38 


0 


34 


1 


f. Certification (specify areas and 
types) 


20 


18 


17 


18 
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APPENDIX B 



REVISED INNOVATIONS EVALUATION GUIDE 



* 




WHAT IT IS 

The Innovations Evaluation Guide is an instrument to help improve 
the decision-making ability of educators who evaluate innovations. 
The Guide classifies innovations by their characteristics in a 
manner which facilitates their evaluation by potential adopters. 



WHY IT WAS DEVELOPED 

Educators often lack pertinent information upon which to base 
their decisions. Use of this Guide will reduce the risk of failure 
due to an oversight in considering essential information. This 
aid to making a more rational decision suggests evaluative criteria 
for assessing an innovation. 



HOW IT WORKS 

The format of the Guide allows the evaluator to do a step-by-step 
analysis of the benefits and costs of an innovation. By providing 
information for the applicable characteristics, the evaluator can 
gain support and approval from those who are affected by his deci- 
sion. Developers and promoters of exemplary innovations can use 
the categories in the Guide to supply consumer information on their 
products . 



WHO CAN USE IT 

The Guide can be used by any educator who has the task of eval- 
uating innovations. Potential users ipclude such people as class- 
room teachers, school administrators, state supervisors of exem- 
plary programs, local educational agency project directors, state 
department personnel, teacher-educators, research and development 
center personnel, and research coordinating unit personnel. 



WHEN TO USE IT 

Educators should find the Guide most helpful when an innovation 
needs to be considered for adoption. It can also be useful as an 
evaluation tool to assess an innovation which is in the trial 
stage of adoption. 



WHAT IT IS NOT 

This Guide does not attempt to assess community or organization 
needs for innovations. The identification of problems and the 
mobilization of resources are the prerogatives of decision-makers 
in educational agencies. 
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Since the purpose of this Guide is to assess innovations 
rather than local situations, the educator must know his 
needs and be able to identify problems which exist. At 
this point, the Guide is useful in evaluating innovations 
as possible solutions to the perceived problems. 

Information on the development of the Innovations Evalua- 
tion Guide can be obtained from the Final Report, The 
Classification and Evaluation of Innovations in Vocational 
and Technical Education, Research Series No. 71. This 
research was conducted at The Center for Vocational and 
Technical Education, The Ohio State University, by William 
L. Hull, principal investigator, and Randall L. Wells, 
research associate. 

A limited number of single copies are available upon re- 
quest from the Product Utilization Specialist at The 
Center. Permission to duplicate this Guide will be 
granted by The Center upon request. 
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BENEFITS 



INDIVIDUAL PUPIL GROWTH 
Rate of learning . 

What effect will the innovation have on the rate of student 
learning? 

Scope of learning . 

How does the innovation affect the number and type of learn- 
ing experiences and/or skills to which the students will be 
exposed? 

Attitude . 

What effect on attitudes can be attributed to the innovation 
(i.e., community, students, teachers, administrators)? Are 
there any experiences which assist the students in the devel- 
opment of their self-concepts and their abilities to relate 
to other individuals? 



PROGRAM OPERATIONS 
Efficiency . 

What information is available which will allow a cost/benefit 
analysis of the innovation? How does this analysis compare 
to the present status or other alternatives? 

Effect iveness . 

What evidence indicates the innovation can achieve the re- 
quired objectives to our satisfaction? 



SOCIETY AND THE ECONOMY 

Entry and advancement in an occupation . 

What effect does the innovation nave on increasing the oppor- 
tunities to acquire job entry skills? Does the innovation 
include activities which will contribute to promotion and 
satisfaction on the job? 

Economic and social efficiencies . 

What effect will the innovation have on productivity and 
costs to society in relation to such items as wages, occupa- 
tional mobility, and school dropout rate? 

Social values . 

What attempts will be made to create an awareness of society 
in the students through the teaching of concepts concerning 
institutions, laws, cultures and social problems? 
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Community involvement . 

What bene tits will accrue to the 
installing the innovation? What 
have on such items as school and 
the public image of the school? 



school and community after 
effect will the innovation 
community relations, and 



CREDIBILITY 

Validity . 

What evidence indicates that the innovation can achieve its 
ob j ectives ? 

Rel iabil i ty . 

Where has the innovation been tested previously? How similar 
are these settings to our situation? 



ASSURANCE CONTRACT 
Warranty . 

To what extent does the developer and/or promoter warrant the 
soundness of the innovation? Who is responsible for assuring 
the services of the innovation? 



Operational assistance . 

Wnat types of consultation and services are provided by the 
sponsoring agency to warrant the product? 



COSTS 



FUNDING 



Cos ts . 

What is the cost per unit over time? Will the innovation 
involve a saving? 



Sources of dollars . 

How can the innovation be funded? Must the cost be borne 
locally, or is assistance available wholly or in part from 
state, federal, or public sources such as foundations? What 
are the possibilities of reallocating present budget items 
to accommodate installation? 



Availability of dollars . 

What processes and/or procedures must be followed to acquire 
the necessary funding? Is the local educational agency in a 
position to expend its own money and be reimbursed later, or 
are funds from other sources available prior to expenditure? 
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«. Proportion of dollars available from different sources . 

In what proportion are funds available from other sources? 

Do matching funds have to be local funds? 

Limitations of use of other than local funds . 

What limitations are placed on the use of other icunds? Can 
funds be used for instruction only, equipment and instruc- 
tion, or equipment, supplies and instruction? Can funds be 
used for items such as construction, food, transportation or 
consul tants? 



TIME CONSIDERATIONS 

Installation time . 

How much time does it take to get the innovation working? 

Lead time . 

What deadlines are placed on activities prior to the oper- 
ating date? How much time is necessary to order and receive 
items such as texts and materials? How much time is neces- 
sary to order, receive, and install equipment? Will the 
innovation require teacher orientation or advanced teacher 
planning time? 

Planning time . 

How mucn time must be devoted to planning by a teacher, coor- 
dinator or administrator during each week? 

Operation time . 

What amount of time is required by the innovation in daily 
preparation, classroom, ac tivities , meetings, etc.? 

Cyclical considerations . 

What characteristics of the innovation dictate that it be 
installed at a particular time during the calendar or academic 
year? 



INSTALLATION CONSIDERATIONS 
Acceptance . 

What barriers can be anticipated from the community, school 
personnel, or students concerning the installation of the 
innovat ion? 

Complexity . 

What is the extent of involvement necessary to install the 
innovation? How many staff members, students, schedules, 
classrooms, laboratories, or schools are involved? 
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Divisibility . 

What are the requirements concerning extent of installation? 
Can it be trial tested by the adopting unit before complete 
installation of the total product? 

Policy changes . 

What changes in policy on the state and local level are nec- 
essary in order for the innovation to be successful (i.e., 
procedure for a field trip on local level; certification 
changes on state level)? 

Degree of development . 

Is the innovation in an installable form or does it require 
more development? Are additional materials or training 
activities necessary? 

Feasibility . 

wnat evidence is there to indicate that the innovation will 
work in our situation? 

Adaptabil ity . 

What adjustments can be made to meet local conditions without 
damaging the authenticity of the innovation? 

ORGANIZATIONAL CHANGE 

Disruption of routine . 

What interruption of routine is required by the innovation 
due to rescheduling of classes, retraining of teachers, 
sharing of facilities, etc.? 

Effect on staff organization . 

What effect will the innovation have on the present structure? 
Does it create a need for a separate division or department? 

Role change for individuals . 

What changes in duties and/or responsibilities are necessary 
for successful operation of the innovation? 

New relationships among groups . 

What new kinds of relationships among departments or grade 
levels will be necessary for successful operation of the 
innovation? 



PERSONNEL NEEDS 

Quantity of staff . 

What additions to the staff are required? How many part-time 
or full-time people per unit are needed? 
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Teaching or other experiences . 

What staff experiences are necessary for successful operation 
of the innovation? Do leaders need to have a knowledge of 
the community? 

Personnel development required by the innovation . 

What requirements are necessary for the development of certain 
role attitudes, skills, and competencies not presently pos- 
sessed by personnel? Is the present staff capable of, and 
willing to handle the personnel development necessary for the 
success of the innovation? Are consultants available? 



SPACE REQUIREMENTS 

Space (Housing) . 

Are present facilities sufficient? If not, what physical 
facilities are necessary to house the innovation? 

Space (Land Use) . 

What acreage is necessary for installing the innovation? 
Arrangement of space to other programs . 

Does the success of the innovation require close proximity to 
ongoing programs or present facilities? On the other hand, 
is a separate location desirable? 

Acquisition of needed space . 

What are the options to acquiring needed space for the inno- 
vation (i.e., donation, purchase, lease, rent, build)? 



EQUIPMENT REQUIREMENTS 
Hardware . 

What are the major items of equipment or their components 
necessary for the operation and success of the innovation? 

Software. 

What supplies are necessary for the operation of the innova 
tion? 



ERIC 



61 






CO 

X 

w 

H 



H 

CO 

O 

U 

O 

< 

o 

PP 

H 

W 

W 

x 

CO 

o 



O 

ERIC 



CO 

W 

CO 



o3 

C a) 
Jh > 
0 *H 
4-> P> 



bo 

c 



cti 

> C 

o o 

G 'H 
P P> 



o3 
C 0 ) 
Jh > 
0 *H 
4 J 4 -> 



03 

> 

O 
C 'H 

G P> 



i 

03 
C 0 
P« > 

0 *H 
4-> P 



03 

> C 

O O 
G *H 
C 4-> 



t0 

4-> 

t0 

O 

U 

PH 

o 

to 

0 

C4 

H 



58 



o 

> 

•H 

4-> 

oJ 

4-> 

to 

• r*H 

c 

• H 
£ 

Td 

< 



0 

C 

C 

o 

tO , 
P<i 
0 

CP ■■ 



03 

U 

•H 

u 

0 

P-H 

CJ 



4-> 

C 

03 

4-» 

pH 

3 

to 

C2 

o 

CJ 



u 

0 

rC 

4-> 



0 

u 

03 

Pi 

CO 

b 0 

C 

•pH 

-a 

p-H 

•pH 

3 

PQ 



to 

0 



U 

03 

Uh 



fa 
c 

03 

to 
to f 
0 03 



1 H 

PH Jh 
PL, 0 

P<4-> 
CT 3 03 

wko s 



0 

> 

cti 

Ph 



03 «P 
05 
bO U 
C 



Pi O 
|Ph u 



Ob 0 

c o 

03 C 
03 

to C 
Pi 0 
pH 4 -> 
03 C 
Ph^pH 
0 03 

C* X 



ob 

03 

0 

X 

Pi 

0 



<P 



bo 

C 

pH 

4-> 

03 

Pi 



0 p, 

P, X 

o w 



to 

pH 

03 

4 -> 

0 
4 -> 

1 

pO 

2 
CO 



62 



P> 

to 

o 

u 



03 

P> 

O 

H 



O 

O 

rC 

u 

to 

Pi 

0 

Pi 

4-> 

to 

o 

u 



•H 

P< 

2 

P< 

Pi r-> 

0 * 

P U 

P> 

4 -> 0 
10 Pi 
O * 0 
U 0 Pi 
P> 

* 03 •* 

. +j . 

0 to 0 

•pH Pi *pH 
v— / q) W 

P 



4-> 


0 




•H 


p» e 




c 


to *H 




X 


0 H 


/■ — \ 




u 


• 


Pi 


Pi 


O 


0 


Pi 0 


4-> 


CU 


0 CU 


0 


* 







instructional hour, per year, *p er Unit/Per Time 



CHECK LIST 



The Innovation will benefit: 

Students 

Teachers 

Administrators 

The School 

The Community 



The State 
The Economy 
Society 

Program Operations 
(Other) 



The Innovation is : 

Acceptable 

Feasible 

Adaptable 

Divis ible 



_ Valid 
Reliable 
Warranted 
(Other) 



The installation requirements are: 

Funding Organizational Change 

Staffing Policy Change 

Housing (Other) 

Equipping 



The objectives for this Innovation are: 
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INSTRUCTION SHEET 

“INNOVATIONS* EVALUATION: A CONSUMER GUIDE’* 



You are being asked to respond to a series of questions which evaluate the benefits and requirements of an 
innovation. 

Because of your involvement in installing an exeinplary innovation, we believe you are qualified to judge the 
appropriateness of information for evaluating prospective innovations. 

INTRODUCTION TO THE GUIDE 

The Innovations’ Evaluation Guide is designed as an aid to administrators, supervisors, and teachers who 
evaluate proposed innovations. 

A step-by-step analysis is made of an innovation’s characteristics. This is an attempt to improve the decision- 
making ability of an adopter by reducing the risk of failure due to oversight of essential information. 

DEFINITION OF INNOVATION 

Since the word “innovation” is used quite frequently, we offer the following as our definition: Something 
new which has never been tried in your school before. 

EXAMPLE OF AN INNOVATION 

Educators become aware of innovations in many ways. One commor* way is the promotion and sale of 
educational products by a commercial concern. Most of you have probably experienced contact with a 
sales representative with something new for the classroom. Suppose your school were approached with the 
idea of adopting an innovation such as programmed instructional materials for vocational education programs. 
The school has never used anything like this before. What information is necessary for you to know in 
order to make a decision to adopt or reject this new method? 

The Guide lists characteristics to consider when evaluating an innovation. As you rate these pharacteristics 
later, it will be helpful to keep in mind different kinds of innovations as frames of reference. Other 
innovations might be new equipment such as an overhead projector, “open-school** concept (e.g., one 
which uses flexible spacing patterns for large and small group activities), and so forth. 

RESPONDENT INFORMATION FORMS 

Both teachers and administrators are serving as respondents for this project, and their perceived responses 
will vary according to their various past and present roles and responsibilities in the school systems. There- 
fore, we would like to get some information from you, the respondent, regarding your present role(s) 
and responsibilities in your school system. 

1. Please supply information on the Respondent Identification Sheet. (Pink) 

2. Please check or supply information for each category which applies to your responsibilities on the 
Role Definition Sheet (Yellow) 

CODE NUMBERS 

All response forms bear a code number. Data gathered on these forms will be analyzed by code numbers 
rather than by your name. 
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Code Number 

RESPONDENT IDENTIFICATION SHEET 

Name 

Title ^ 

How do you spend your time at school? (% of time - must total 100%) 

Teaching 

Administrative duties 

Counseling students 

Tenure in Present School (in years) 

Total Experience in School Work (in years) 

Please identify other educational occupations you have been in: 



Age (in years) 
Sex 
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THE CENTEft FOE VOCATIONAL 
AND TECHNICAL IOUCaTiON 

t HE OHIO STATE UnIVEESITT 



Code Number 



ROLE DEFINITION SHEET 



•Check categories that 
define your role 



CATEGORIES COMMENTS 





In School Role Duties 

a. Class Scheduling (Le., determining number of 
students in class and time/place of class) 






b. Purchasing 

1. Equipment (Le., overheads, tape recorders, 
etc.) 


Recommending Only 




2. Expendables (i.e., general supplies, text books) 


Recommending Only 




c. Extra Duties (Le., bus, lunch room, hall, etc.) 






d. Curriculum Planning 
1. Department 






2. Interdisciplinary 






3. School (total) 






4, Intei^-sohool 






5. District 






6. State 






If National 






8. Other (specify) 






e. Financing (setting up budgets) 
1. Department 






2. School (total) 






3. District 






4. Other (specify) 






f. Implementing Programs and/or Projects 
1. Department 






2. Interdisciplinary 






3. School (total 






4. Inter-school 
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CATEGORIES 



COMMENTS 



(*)* 





5. District 






6. State 






7. National 






8. Other (specify) 






g. Administration Services 
L Planning (specify) 






2. Committee Work 






h. Hiring 

1. Interviewing 






2. Recommending 






S. Decision— Making 






Related School Tasks 
a. Yearbook Committee 






b* Coaching (specify) 






c. Club Sponsor (specify) 






d. Other (specify) 






Formal Representative Of: 
a. Who 

1. Teacher group (specify) 






2. School 






3. Department (specify) 






4. Students 






S, Own Position 






t. School District 






U tx To Whom 

L Other teacher* 






. 2. Central Administration 






3. Other principals 
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CATEGORIES 



COMMENTS 



(✓)* 





4. Parents 






5. Business 






6. Community Organizations 






7. School Board 






8. Professional Organizations (specify) 






c. For What Purpose 
1. Reporting grades 






2. Explaining school programs (Information) 





3. Gaining support for school programs 



4. Curricular Coordination within the school 



5* Curricular Coordination Between schools 
within the district 



6. Representation Purposes (Le., voting, 
discussion, etc.) 



Professional Activities — Give names of organizations. 
You" may abbreviate.) 
a. Membership 

(local) 



(state) 
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CATEGORIES 



COMMENTS 



(*>)* 





Academic Preparation 




a. No degree 




b. Bachelors (specify areas) 






c. Master (specify areas) 






d. Specialist (specify areas) 






e. Doctorate (specify areas) 






t Certification (specify areas and types) 
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Rating Sheet Instructions 

The Innovations’ Evaluation Guide (Blue) is the focus of this project Please give us your perceived response 
for each item in the Guide by using the Rating Sheet (Green). Look at the Guide and Rating Sheet 

1. Read each item in the Guide beginning with Item A.l.a., "Increased rate of learning.” Find 
the corresponding item on the Rating Sheet 

2 . Determine the value of each item to you as a decision-maker by first deciding the primary users 
of the information: teachers, administrators, or both; then. . . 

secondly, deciding if the information gained from the question is "essential” or just "helpful” 

3. Circle ONLY ONE X to indicate your choice. 

Example: John Jones is involved in evaluating an innovation. Upon considering the item below 
he decides that (1) the primary user of this information would be both , and (2) it is essentia] 
in considering the innovation. His response would be as follows: 




Primary User 

Item Teacher Both Administrator 

Ess. Help _ Ej& Help Ess. Help 

Accuracy of information in new textbook. X X 00 X X X 

4 . There is a box on the left of the rating sheet for each sub-heading. After all individual items 
have been rated, rank the three sub-headings you consider most important as considerations in 
adopting an innovation. (Place number in appropriate box) 

1 — most important 

2 — second most important 

3 — third most important 



Next, rank the three least important sub— headings as follows: (Place number in box) 

11 — least important 
10 — second least important 
9 — third least important 

5. Feel free to make verbal or written comments on the Guide while you are rating items. We 
will revise the guide based on your responses. Please save some time to recommend additional 
items, or the deletion of existing items. 
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TH1 CENTER FOR VOCATIONAL 
AND TECHNICAL EDUCATION 




THE OHIO STATE UNIVERSITY 
1900 Kannjf Id., Colwmbut, Ohio, 43210 



INNOVATIONS’ EVALUATION: A CONSUMER GUIDE 



This document is designed for administrators, supervisors, and teachers who 
evaluate proposed innovations. It is an attempt to improve the decision-making 
ability of an adopter by reducing the risk of failure due to oversight of essential 
information. 

By analyzing the innovation and examining its major components, the reader can 
evaluate its utility in relation to his needs and other new ideas. 

The guide will serve to make the adopter aware of the preliminary requirements 
necessary for an effective implementation of an innovation. 



November 1971 




ERIC 



71 




1 



INNOVATIONS’ EVALUATION: A CONSUMER GUIDE 



A. BENEFITS 

1. INDIVIDUAL PUPIL GROWTH 



a. Increased rate of learning 

What effect will the innovation hive on the rate of student growth? 

b. Increased scope of learning 

Does the innovation increase the number and type of learning experiences and/or skills 
to which students will be exposed? 

c. Attitude improvement 

What effect on attitudes can be attributed to the innovation? (Le., community, students, 
teachers, administrators) 

2. PROGRAM OPERATIONS 

a. Increased efficiency 



3. KEY INDICATORS OF INNOVATION SUCCESS 

a. Entry and advancement in an occupation 

What effect does the innovation have on increasing the opportunity to acquire job entry 
skills? Will the innovation contribute to job satisfaction? Does th r novation include 
activities which will contribute to promotion on the job? 

b. Economic and social efficiencies 

What effect will the innovation have on productivity and costs to society in relation to such 
items as wages, occupational mobility, and school dropout rate? 

c. Personal human values 

Are there any experiences provided which assist the students in the development of their 
self-concepts? Is an opportunity provided, and are concepts used to facilitate the students’ 
skills in relating to other individuals? Is there an attempt to create an awareness of society 
in the students through the teaching of concepts concerning institutions, laws, cultures and 
social problems? 

4. LEGITIMACY OF THE INNOVATION 

a. Validity 

Is there evidence to show that the innovation does achieve its objectives? 

b. Reliability 

Has the innovation been tested in schools similar to ours? 



Is the innovation worth the money? Does it provide more benefits per dollar than other 
ideas? 



Increased effectiveness 

To what extent will the innovation improve the present program? 
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B. COSTS 



1. FUNDING 

a. Costs 

What amount is necessary to get the innovation into operation? What is the cost per unit 
over time? What additional costs are involved? Will the innovation involve a saving? Can 
present budget be reallocated to accommodate installation? 

b. Sources of dollars 

How can the innovation be funded? Must the cost be borne locally, or is assistance 
available wholly or in part from state, federal, or public sources such as foundations? 

c. Availability of dollars 

What processes and/or procedures must be followed to acquire the necessary funding? Is 
the local educational agency in a position to expend its own money and be reimbursed later, 
or are funds frAm other sources available prior to expenditure? Is advanced funding 
necessary in order to adopt the innovation? 

d Proportion of dollars available from different sources 

In what proportion are funds available from other sources? Do matching funds have to be 
local funds? 

e. Limitations on use of other than local funds 

What limitations are placed on the use of other funds? Can funds be used for instruction 
only, equipment and instruction, or equipment, supplies, and instruction? Can funds be used 
for items such as construction, food, transportation or consultants? 

2. TIME CONSIDERATIONS 

a. Lead time 

What deadlines are placed on activities prior to the operating date? How much time is 
necessary to order and receive items such as texts and materials? How much time is 
necessary to order, receive, and install equipment? Will the innovation require teacher 
orientation? 

b. Installation time 

How much time does it take to get the innovation working? 

c. Operation time 

What amount of time is required by the innovation in daily preparation, classroom activities, 
meetings, etc.? 

d Cyclical considerations 

Does tfoe nature of the innovation dictate that it be installed at a particular time during 
the calendar or academic year? 

3 . INSTALLATION CONSIDERATIONS 
a. Acceptance 

What barriers can be anticipated from the community, school personnel, or students concerning 
the installation of the innovation? 
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b. Complexity 

What is the extent of involvement necessary to install the innovation? How many staff 
members, students, schedules, classrooms, laboratories, or schools are involved? 

c. Divisibility 

Does the innovation lend itself to stages of installation? 

d. Policy changes 

What changes in policy on the state and local level are necessary in order for the innovation to be 
successful? (i.e., procedure for a field trip on local level; certification changes on state level) 

e. Degree of development 

Is the innovation in an installable form or does it require more development? Are additional 
materials or training activities necessary? 

f. Feasibility 

Is there a good chance that the innovation will work in this school and/or district? 

4. ORGANIZATIONAL CHANGE 

a. Disruption of routine 

What interruption of routine is required by the innovation due to rescheduling of classes, 
retraining of teachers, sharing of facilities, etc.? 

b. Effect on staff organization 

Does the innovation fit into the present structure, or does it create a need for a separate 
division or department? 

c. New roles for individuals 

What changes in duties and/or responsibilities are necessary for successful operation of the 
innovation? 

d. New relationships among groups 

Whut new kinds of relation&nips among departments or grade levels will be necessary for 
successful operation of the innovation? 

5. PERSONNEL NEEDS 

a. Quantity of staff 

What additions to the staff are required? How many part-time of full-time people per unit 
are needed? 

b. Teaching pr other experience 

What staff experiences are necessary for successful operation of the innovation? Do leaders 
need {o have a knowledge of the community? 

r Personnel development required by the innovation 

What new roles are created for present administrators and teaching personnel? Does the 
nature sf the innovation require the development of certain attitudes, skills, and com- 
petencies now presently possessed by personnel? Is the present staff capable of, and willing 
to handle the personnel development necessary for the success of the innovation? Are 
consultants available? 
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6. SPACE REQUIREMENTS 



a. Space (Housing) 

Are present facilities sufficient? If not, what physical facilities are necessary to house the 
innovation? 

b. Space (Land Use) 

What acreage is necessary for installing the innovation? 

c * Arrangement of space to other programs 

Does the success of the innovation require close proximity to ongoing programs or present 
facilities? On the other hand, is a separate location desirable? 

<L Acquisition of needed space 

What are the options to acquiring needed space for the innovation? (i.e., donation, purchase, 
lease, rent, build) 

EQUIPMENT REQUIREMENTS 
a. Hardware 

Are major items of equipment or their components necessary for the operation and success 
of the innovation? 



b. Software 

What supplies are necessary for the operation of the innovation? 
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APPENDIX D 



EXEMPLARY PROJECT DIRECTORS AND SITES 



Director 



Site 



Mr. James Hugueley 



Project SPAN 

1212 Vollentien Street 

Memphis, Tennessee 38104 



Mr. R. T. Ishee 



Exemplary Projects 
Jones County Schools 
Laurel, Mississippi 39440 



Dr. John Jenkins Pikeville Exemplary Career 

Education Project 
Pikeville, Kentucky 41501 



Mr. Joel Smith Cobb County Occupational and 

Career Development Program 
P.0. Drawer R 
Marietta, Georgia 30060 
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Paul W. Briggs, Superintendent 
Cleveland City Schools 
1380 East 6th Street 
Cleveland, Ohio 44114 
(216) 696-2929 

John Ellis, Superintendent 
Lakewood City Schools 
1470 Warren Road 
Lakewood, Ohio 44107 
(216) 579-4092 

Paul C. Hayes (previously 
superintendent of the 
Southwestern City Schools) 
Professor of Educational 
Administration 
University of Akron 
Akron, Ohio 44300 



Robert E. Lucas, Superintendent 
Princeton City Schools 
10428 Reading Road 
Cincinnati, Ohio 45241 
(513) 563-1240 

Thomas C. Porter, Superintendent 
Tri-County Joint Vocational 
School 
Route #1 
Kimberly Road 
Nelsonville, Ohio 45764 
(614) 753-3511 

Richard L. Preston, Superin- 
tendent 

Centerville City Schools 
111 Virginia Avenue 
Centerville, Ohio 45459 
(513) 885-5841 
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Questions asked of each superintendent 

1. What sources of information do you seek before adopting 
specific innovations? 

2. What do you need to know about an innovation before 
deciding to try it? 



3. What are the most persistent problems or barriers to the 
implementation of innovations in your school system? 

4. What factors account for your school's success in implement- 
ing innovations? 



o 
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